2023-10-01 22:01:14,351 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-10-01 22:01:14,568 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f 2023-10-01 22:01:14,568 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-10-01 22:01:14,568 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-10-01 22:01:14,605 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-10-01 22:01:14,868 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-10-01 22:01:14,869 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/cluster_acb7ca10-02c8-106a-9d3a-fe6c12cc0094, deleteOnExit=true 2023-10-01 22:01:14,869 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-10-01 22:01:14,870 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/test.cache.data in system properties and HBase conf 2023-10-01 22:01:14,871 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/hadoop.tmp.dir in system properties and HBase conf 2023-10-01 22:01:14,871 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/hadoop.log.dir in system properties and HBase conf 2023-10-01 22:01:14,872 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-01 22:01:14,872 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-01 22:01:14,872 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-01 22:01:15,199 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-10-01 22:01:15,203 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-01 22:01:15,204 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-01 22:01:15,204 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-01 22:01:15,204 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-01 22:01:15,205 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-01 22:01:15,205 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-01 22:01:15,206 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-01 22:01:15,206 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-01 22:01:15,207 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-01 22:01:15,207 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/nfs.dump.dir in system properties and HBase conf 2023-10-01 22:01:15,208 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/java.io.tmpdir in system properties and HBase conf 2023-10-01 22:01:15,208 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-01 22:01:15,208 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-01 22:01:15,209 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-10-01 22:01:15,712 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-01 22:01:15,716 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-01 22:01:16,024 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-10-01 22:01:16,187 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-10-01 22:01:16,201 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 22:01:16,240 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 22:01:16,275 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/java.io.tmpdir/Jetty_localhost_38757_hdfs____.bvrfeq/webapp 2023-10-01 22:01:16,415 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38757 2023-10-01 22:01:16,427 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-01 22:01:16,427 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-01 22:01:16,927 WARN [Listener at localhost/36919] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-01 22:01:17,009 WARN [Listener at localhost/36919] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-01 22:01:17,030 WARN [Listener at localhost/36919] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 22:01:17,084 INFO [Listener at localhost/36919] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 22:01:17,093 INFO [Listener at localhost/36919] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/java.io.tmpdir/Jetty_localhost_40371_datanode____ok1dq0/webapp 2023-10-01 22:01:17,192 INFO [Listener at localhost/36919] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40371 2023-10-01 22:01:17,653 WARN [Listener at localhost/42353] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-01 22:01:17,668 WARN [Listener at localhost/42353] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-01 22:01:17,673 WARN [Listener at localhost/42353] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 22:01:17,675 INFO [Listener at localhost/42353] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 22:01:17,689 INFO [Listener at localhost/42353] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/java.io.tmpdir/Jetty_localhost_36315_datanode____.hq76it/webapp 2023-10-01 22:01:17,808 INFO [Listener at localhost/42353] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36315 2023-10-01 22:01:17,821 WARN [Listener at localhost/35041] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-01 22:01:17,843 WARN [Listener at localhost/35041] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-01 22:01:17,847 WARN [Listener at localhost/35041] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 22:01:17,849 INFO [Listener at localhost/35041] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 22:01:17,860 INFO [Listener at localhost/35041] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/java.io.tmpdir/Jetty_localhost_44183_datanode____.645xv1/webapp 2023-10-01 22:01:17,993 INFO [Listener at localhost/35041] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44183 2023-10-01 22:01:18,005 WARN [Listener at localhost/38397] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-01 22:01:18,301 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x898aff5502ac0da3: Processing first storage report for DS-9f26927d-96bd-4e3e-af39-de2712fcd991 from datanode 44a7e160-a6d1-4708-8ab9-39315d672d97 2023-10-01 22:01:18,303 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x898aff5502ac0da3: from storage DS-9f26927d-96bd-4e3e-af39-de2712fcd991 node DatanodeRegistration(127.0.0.1:44265, datanodeUuid=44a7e160-a6d1-4708-8ab9-39315d672d97, infoPort=41413, infoSecurePort=0, ipcPort=38397, storageInfo=lv=-57;cid=testClusterID;nsid=1891761051;c=1696197675797), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-10-01 22:01:18,303 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd58931efa09860e6: Processing first storage report for DS-ddd95b61-9f87-4546-9d26-0b3f08890a6a from datanode 89282f88-5912-460c-9d8f-7c35cfc40d16 2023-10-01 22:01:18,303 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd58931efa09860e6: from storage DS-ddd95b61-9f87-4546-9d26-0b3f08890a6a node DatanodeRegistration(127.0.0.1:41221, datanodeUuid=89282f88-5912-460c-9d8f-7c35cfc40d16, infoPort=34307, infoSecurePort=0, ipcPort=35041, storageInfo=lv=-57;cid=testClusterID;nsid=1891761051;c=1696197675797), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-10-01 22:01:18,303 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xad25f5661227c27: Processing first storage report for DS-89e8b865-52b2-4372-8d32-51fa3f7c6769 from datanode 0d33a4ea-52ef-4d1b-9689-16605c76b96e 2023-10-01 22:01:18,304 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xad25f5661227c27: from storage DS-89e8b865-52b2-4372-8d32-51fa3f7c6769 node DatanodeRegistration(127.0.0.1:32835, datanodeUuid=0d33a4ea-52ef-4d1b-9689-16605c76b96e, infoPort=43709, infoSecurePort=0, ipcPort=42353, storageInfo=lv=-57;cid=testClusterID;nsid=1891761051;c=1696197675797), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-01 22:01:18,304 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x898aff5502ac0da3: Processing first storage report for DS-60f304bb-b748-46e6-80a0-c2dea1f39ab5 from datanode 44a7e160-a6d1-4708-8ab9-39315d672d97 2023-10-01 22:01:18,304 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x898aff5502ac0da3: from storage DS-60f304bb-b748-46e6-80a0-c2dea1f39ab5 node DatanodeRegistration(127.0.0.1:44265, datanodeUuid=44a7e160-a6d1-4708-8ab9-39315d672d97, infoPort=41413, infoSecurePort=0, ipcPort=38397, storageInfo=lv=-57;cid=testClusterID;nsid=1891761051;c=1696197675797), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-01 22:01:18,304 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd58931efa09860e6: Processing first storage report for DS-c8ca8afe-e2c6-4c48-bd1a-f13e183da6cc from datanode 89282f88-5912-460c-9d8f-7c35cfc40d16 2023-10-01 22:01:18,304 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd58931efa09860e6: from storage DS-c8ca8afe-e2c6-4c48-bd1a-f13e183da6cc node DatanodeRegistration(127.0.0.1:41221, datanodeUuid=89282f88-5912-460c-9d8f-7c35cfc40d16, infoPort=34307, infoSecurePort=0, ipcPort=35041, storageInfo=lv=-57;cid=testClusterID;nsid=1891761051;c=1696197675797), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-10-01 22:01:18,304 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xad25f5661227c27: Processing first storage report for DS-538c3df0-d0c1-4691-a32b-384f9e886833 from datanode 0d33a4ea-52ef-4d1b-9689-16605c76b96e 2023-10-01 22:01:18,304 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xad25f5661227c27: from storage DS-538c3df0-d0c1-4691-a32b-384f9e886833 node DatanodeRegistration(127.0.0.1:32835, datanodeUuid=0d33a4ea-52ef-4d1b-9689-16605c76b96e, infoPort=43709, infoSecurePort=0, ipcPort=42353, storageInfo=lv=-57;cid=testClusterID;nsid=1891761051;c=1696197675797), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-01 22:01:18,475 DEBUG [Listener at localhost/38397] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f 2023-10-01 22:01:18,562 INFO [Listener at localhost/38397] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/cluster_acb7ca10-02c8-106a-9d3a-fe6c12cc0094/zookeeper_0, clientPort=58905, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/cluster_acb7ca10-02c8-106a-9d3a-fe6c12cc0094/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/cluster_acb7ca10-02c8-106a-9d3a-fe6c12cc0094/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-10-01 22:01:18,585 INFO [Listener at localhost/38397] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58905 2023-10-01 22:01:18,596 INFO [Listener at localhost/38397] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 22:01:18,598 INFO [Listener at localhost/38397] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 22:01:19,298 INFO [Listener at localhost/38397] util.FSUtils(471): Created version file at hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9 with version=8 2023-10-01 22:01:19,298 INFO [Listener at localhost/38397] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/hbase-staging 2023-10-01 22:01:19,712 INFO [Listener at localhost/38397] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-10-01 22:01:20,202 INFO [Listener at localhost/38397] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-10-01 22:01:20,235 INFO [Listener at localhost/38397] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 22:01:20,236 INFO [Listener at localhost/38397] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-01 22:01:20,236 INFO [Listener at localhost/38397] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-01 22:01:20,236 INFO [Listener at localhost/38397] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 22:01:20,236 INFO [Listener at localhost/38397] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-01 22:01:20,391 INFO [Listener at localhost/38397] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-10-01 22:01:20,464 DEBUG [Listener at localhost/38397] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-10-01 22:01:20,556 INFO [Listener at localhost/38397] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40311 2023-10-01 22:01:20,570 INFO [Listener at localhost/38397] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 22:01:20,572 INFO [Listener at localhost/38397] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 22:01:20,595 INFO [Listener at localhost/38397] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40311 connecting to ZooKeeper ensemble=127.0.0.1:58905 2023-10-01 22:01:20,646 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:403110x0, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-01 22:01:20,649 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:40311-0x1010401cd730000 connected 2023-10-01 22:01:20,681 DEBUG [Listener at localhost/38397] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-01 22:01:20,682 DEBUG [Listener at localhost/38397] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 22:01:20,695 DEBUG [Listener at localhost/38397] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-01 22:01:20,703 DEBUG [Listener at localhost/38397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40311 2023-10-01 22:01:20,703 DEBUG [Listener at localhost/38397] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40311 2023-10-01 22:01:20,703 DEBUG [Listener at localhost/38397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40311 2023-10-01 22:01:20,704 DEBUG [Listener at localhost/38397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40311 2023-10-01 22:01:20,705 DEBUG [Listener at localhost/38397] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40311 2023-10-01 22:01:20,711 INFO [Listener at localhost/38397] master.HMaster(444): hbase.rootdir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9, hbase.cluster.distributed=false 2023-10-01 22:01:20,775 INFO [Listener at localhost/38397] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-01 22:01:20,775 INFO [Listener at localhost/38397] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 22:01:20,775 INFO [Listener at localhost/38397] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-01 22:01:20,775 INFO [Listener at localhost/38397] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-01 22:01:20,775 INFO [Listener at localhost/38397] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 22:01:20,776 INFO [Listener at localhost/38397] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-01 22:01:20,780 INFO [Listener at localhost/38397] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-01 22:01:20,783 INFO [Listener at localhost/38397] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42263 2023-10-01 22:01:20,786 INFO [Listener at localhost/38397] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-01 22:01:20,793 INFO [Listener at localhost/38397] mob.MobFileCache(125): MobFileCache disabled 2023-10-01 22:01:20,794 INFO [Listener at localhost/38397] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 22:01:20,796 INFO [Listener at localhost/38397] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 22:01:20,799 INFO [Listener at localhost/38397] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42263 connecting to ZooKeeper ensemble=127.0.0.1:58905 2023-10-01 22:01:20,805 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:422630x0, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-01 22:01:20,806 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42263-0x1010401cd730001 connected 2023-10-01 22:01:20,806 DEBUG [Listener at localhost/38397] zookeeper.ZKUtil(164): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-01 22:01:20,808 DEBUG [Listener at localhost/38397] zookeeper.ZKUtil(164): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 22:01:20,809 DEBUG [Listener at localhost/38397] zookeeper.ZKUtil(164): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-01 22:01:20,809 DEBUG [Listener at localhost/38397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42263 2023-10-01 22:01:20,809 DEBUG [Listener at localhost/38397] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42263 2023-10-01 22:01:20,810 DEBUG [Listener at localhost/38397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42263 2023-10-01 22:01:20,810 DEBUG [Listener at localhost/38397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42263 2023-10-01 22:01:20,813 DEBUG [Listener at localhost/38397] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42263 2023-10-01 22:01:20,826 INFO [Listener at localhost/38397] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-01 22:01:20,826 INFO [Listener at localhost/38397] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 22:01:20,826 INFO [Listener at localhost/38397] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-01 22:01:20,826 INFO [Listener at localhost/38397] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-01 22:01:20,827 INFO [Listener at localhost/38397] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 22:01:20,827 INFO [Listener at localhost/38397] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-01 22:01:20,827 INFO [Listener at localhost/38397] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-01 22:01:20,829 INFO [Listener at localhost/38397] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37145 2023-10-01 22:01:20,830 INFO [Listener at localhost/38397] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-01 22:01:20,831 INFO [Listener at localhost/38397] mob.MobFileCache(125): MobFileCache disabled 2023-10-01 22:01:20,832 INFO [Listener at localhost/38397] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 22:01:20,834 INFO [Listener at localhost/38397] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 22:01:20,838 INFO [Listener at localhost/38397] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37145 connecting to ZooKeeper ensemble=127.0.0.1:58905 2023-10-01 22:01:20,842 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:371450x0, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-01 22:01:20,843 DEBUG [Listener at localhost/38397] zookeeper.ZKUtil(164): regionserver:371450x0, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-01 22:01:20,844 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37145-0x1010401cd730002 connected 2023-10-01 22:01:20,844 DEBUG [Listener at localhost/38397] zookeeper.ZKUtil(164): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 22:01:20,845 DEBUG [Listener at localhost/38397] zookeeper.ZKUtil(164): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-01 22:01:20,849 DEBUG [Listener at localhost/38397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37145 2023-10-01 22:01:20,849 DEBUG [Listener at localhost/38397] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37145 2023-10-01 22:01:20,850 DEBUG [Listener at localhost/38397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37145 2023-10-01 22:01:20,850 DEBUG [Listener at localhost/38397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37145 2023-10-01 22:01:20,851 DEBUG [Listener at localhost/38397] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37145 2023-10-01 22:01:20,863 INFO [Listener at localhost/38397] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-01 22:01:20,863 INFO [Listener at localhost/38397] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 22:01:20,863 INFO [Listener at localhost/38397] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-01 22:01:20,863 INFO [Listener at localhost/38397] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-01 22:01:20,863 INFO [Listener at localhost/38397] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 22:01:20,863 INFO [Listener at localhost/38397] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-01 22:01:20,863 INFO [Listener at localhost/38397] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-01 22:01:20,865 INFO [Listener at localhost/38397] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39235 2023-10-01 22:01:20,865 INFO [Listener at localhost/38397] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-01 22:01:20,869 INFO [Listener at localhost/38397] mob.MobFileCache(125): MobFileCache disabled 2023-10-01 22:01:20,870 INFO [Listener at localhost/38397] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 22:01:20,872 INFO [Listener at localhost/38397] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 22:01:20,875 INFO [Listener at localhost/38397] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39235 connecting to ZooKeeper ensemble=127.0.0.1:58905 2023-10-01 22:01:20,878 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:392350x0, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-01 22:01:20,879 DEBUG [Listener at localhost/38397] zookeeper.ZKUtil(164): regionserver:392350x0, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-01 22:01:20,879 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39235-0x1010401cd730003 connected 2023-10-01 22:01:20,879 DEBUG [Listener at localhost/38397] zookeeper.ZKUtil(164): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 22:01:20,880 DEBUG [Listener at localhost/38397] zookeeper.ZKUtil(164): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-01 22:01:20,881 DEBUG [Listener at localhost/38397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39235 2023-10-01 22:01:20,881 DEBUG [Listener at localhost/38397] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39235 2023-10-01 22:01:20,881 DEBUG [Listener at localhost/38397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39235 2023-10-01 22:01:20,885 DEBUG [Listener at localhost/38397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39235 2023-10-01 22:01:20,885 DEBUG [Listener at localhost/38397] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39235 2023-10-01 22:01:20,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40311,1696197679483 2023-10-01 22:01:20,896 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-01 22:01:20,897 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40311,1696197679483 2023-10-01 22:01:20,918 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-01 22:01:20,918 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-01 22:01:20,918 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-01 22:01:20,918 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-01 22:01:20,918 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 22:01:20,920 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-01 22:01:20,921 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40311,1696197679483 from backup master directory 2023-10-01 22:01:20,921 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-01 22:01:20,925 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40311,1696197679483 2023-10-01 22:01:20,926 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-01 22:01:20,926 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-01 22:01:20,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,40311,1696197679483 2023-10-01 22:01:20,929 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-10-01 22:01:20,931 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-10-01 22:01:21,025 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/hbase.id with ID: b58f3f3f-2347-4f1e-8398-b4ca8c1b22d9 2023-10-01 22:01:21,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 22:01:21,084 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 22:01:21,134 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x427467e0 to 127.0.0.1:58905 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 22:01:21,166 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@771c5a27, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 22:01:21,191 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-01 22:01:21,192 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-10-01 22:01:21,209 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-10-01 22:01:21,210 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-10-01 22:01:21,212 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-01 22:01:21,216 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-01 22:01:21,217 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-01 22:01:21,255 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/MasterData/data/master/store-tmp 2023-10-01 22:01:21,293 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:01:21,293 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-01 22:01:21,293 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 22:01:21,293 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 22:01:21,293 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-01 22:01:21,293 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 22:01:21,294 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 22:01:21,294 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-01 22:01:21,296 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/MasterData/WALs/jenkins-hbase4.apache.org,40311,1696197679483 2023-10-01 22:01:21,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40311%2C1696197679483, suffix=, logDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/MasterData/WALs/jenkins-hbase4.apache.org,40311,1696197679483, archiveDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/MasterData/oldWALs, maxLogs=10 2023-10-01 22:01:21,384 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44265,DS-9f26927d-96bd-4e3e-af39-de2712fcd991,DISK] 2023-10-01 22:01:21,384 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32835,DS-89e8b865-52b2-4372-8d32-51fa3f7c6769,DISK] 2023-10-01 22:01:21,384 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41221,DS-ddd95b61-9f87-4546-9d26-0b3f08890a6a,DISK] 2023-10-01 22:01:21,403 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-10-01 22:01:21,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/MasterData/WALs/jenkins-hbase4.apache.org,40311,1696197679483/jenkins-hbase4.apache.org%2C40311%2C1696197679483.1696197681329 2023-10-01 22:01:21,479 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32835,DS-89e8b865-52b2-4372-8d32-51fa3f7c6769,DISK], DatanodeInfoWithStorage[127.0.0.1:41221,DS-ddd95b61-9f87-4546-9d26-0b3f08890a6a,DISK], DatanodeInfoWithStorage[127.0.0.1:44265,DS-9f26927d-96bd-4e3e-af39-de2712fcd991,DISK]] 2023-10-01 22:01:21,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-10-01 22:01:21,481 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:01:21,485 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-10-01 22:01:21,487 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-10-01 22:01:21,555 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-10-01 22:01:21,562 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-10-01 22:01:21,591 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-10-01 22:01:21,604 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 22:01:21,611 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-01 22:01:21,613 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-01 22:01:21,627 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-10-01 22:01:21,631 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 22:01:21,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63496465, jitterRate=-0.05382893979549408}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 22:01:21,632 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-01 22:01:21,633 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-10-01 22:01:21,655 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-10-01 22:01:21,655 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-10-01 22:01:21,658 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-10-01 22:01:21,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-10-01 22:01:21,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 35 msec 2023-10-01 22:01:21,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-10-01 22:01:21,725 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-10-01 22:01:21,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-10-01 22:01:21,756 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-10-01 22:01:21,761 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-10-01 22:01:21,762 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-10-01 22:01:21,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-10-01 22:01:21,772 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-10-01 22:01:21,776 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 22:01:21,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-10-01 22:01:21,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-10-01 22:01:21,792 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-10-01 22:01:21,796 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-01 22:01:21,796 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-01 22:01:21,796 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-01 22:01:21,796 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-01 22:01:21,797 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 22:01:21,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,40311,1696197679483, sessionid=0x1010401cd730000, setting cluster-up flag (Was=false) 2023-10-01 22:01:21,814 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 22:01:21,820 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-10-01 22:01:21,822 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40311,1696197679483 2023-10-01 22:01:21,828 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 22:01:21,833 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-10-01 22:01:21,837 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40311,1696197679483 2023-10-01 22:01:21,840 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp 2023-10-01 22:01:21,890 INFO [RS:1;jenkins-hbase4:37145] regionserver.HRegionServer(951): ClusterId : b58f3f3f-2347-4f1e-8398-b4ca8c1b22d9 2023-10-01 22:01:21,890 INFO [RS:0;jenkins-hbase4:42263] regionserver.HRegionServer(951): ClusterId : b58f3f3f-2347-4f1e-8398-b4ca8c1b22d9 2023-10-01 22:01:21,891 INFO [RS:2;jenkins-hbase4:39235] regionserver.HRegionServer(951): ClusterId : b58f3f3f-2347-4f1e-8398-b4ca8c1b22d9 2023-10-01 22:01:21,896 DEBUG [RS:1;jenkins-hbase4:37145] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-01 22:01:21,896 DEBUG [RS:0;jenkins-hbase4:42263] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-01 22:01:21,896 DEBUG [RS:2;jenkins-hbase4:39235] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-01 22:01:21,903 DEBUG [RS:1;jenkins-hbase4:37145] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-01 22:01:21,903 DEBUG [RS:0;jenkins-hbase4:42263] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-01 22:01:21,903 DEBUG [RS:2;jenkins-hbase4:39235] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-01 22:01:21,904 DEBUG [RS:0;jenkins-hbase4:42263] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-01 22:01:21,904 DEBUG [RS:1;jenkins-hbase4:37145] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-01 22:01:21,904 DEBUG [RS:2;jenkins-hbase4:39235] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-01 22:01:21,908 DEBUG [RS:0;jenkins-hbase4:42263] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-01 22:01:21,911 DEBUG [RS:0;jenkins-hbase4:42263] zookeeper.ReadOnlyZKClient(139): Connect 0x309db57c to 127.0.0.1:58905 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 22:01:21,914 DEBUG [RS:1;jenkins-hbase4:37145] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-01 22:01:21,915 DEBUG [RS:2;jenkins-hbase4:39235] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-01 22:01:21,916 DEBUG [RS:1;jenkins-hbase4:37145] zookeeper.ReadOnlyZKClient(139): Connect 0x4ff98d89 to 127.0.0.1:58905 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 22:01:21,917 DEBUG [RS:2;jenkins-hbase4:39235] zookeeper.ReadOnlyZKClient(139): Connect 0x6f2a1dcd to 127.0.0.1:58905 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 22:01:21,919 DEBUG [RS:0;jenkins-hbase4:42263] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e5a5d1f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 22:01:21,920 DEBUG [RS:0;jenkins-hbase4:42263] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a65de0c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-01 22:01:21,923 DEBUG [RS:1;jenkins-hbase4:37145] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@413e6a06, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 22:01:21,924 DEBUG [RS:1;jenkins-hbase4:37145] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4501e6f9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-01 22:01:21,929 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-10-01 22:01:21,944 DEBUG [RS:2;jenkins-hbase4:39235] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61edfe58, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 22:01:21,944 DEBUG [RS:2;jenkins-hbase4:39235] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65d276bd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-01 22:01:21,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 22:01:21,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-10-01 22:01:21,969 DEBUG [RS:0;jenkins-hbase4:42263] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:42263 2023-10-01 22:01:21,969 DEBUG [RS:1;jenkins-hbase4:37145] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:37145 2023-10-01 22:01:21,969 DEBUG [RS:2;jenkins-hbase4:39235] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:39235 2023-10-01 22:01:21,976 INFO [RS:1;jenkins-hbase4:37145] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-01 22:01:21,976 INFO [RS:0;jenkins-hbase4:42263] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-01 22:01:21,977 INFO [RS:0;jenkins-hbase4:42263] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-01 22:01:21,976 INFO [RS:2;jenkins-hbase4:39235] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-01 22:01:21,977 INFO [RS:1;jenkins-hbase4:37145] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-01 22:01:21,977 INFO [RS:2;jenkins-hbase4:39235] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-01 22:01:21,977 DEBUG [RS:0;jenkins-hbase4:42263] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-01 22:01:21,977 DEBUG [RS:2;jenkins-hbase4:39235] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-01 22:01:21,977 DEBUG [RS:1;jenkins-hbase4:37145] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-01 22:01:21,978 INFO [RS:0;jenkins-hbase4:42263] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 22:01:21,978 INFO [RS:1;jenkins-hbase4:37145] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 22:01:21,978 DEBUG [RS:1;jenkins-hbase4:37145] regionserver.HRegionServer(1022): About to register with Master. 2023-10-01 22:01:21,978 DEBUG [RS:0;jenkins-hbase4:42263] regionserver.HRegionServer(1022): About to register with Master. 2023-10-01 22:01:21,978 INFO [RS:2;jenkins-hbase4:39235] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 22:01:21,979 DEBUG [RS:2;jenkins-hbase4:39235] regionserver.HRegionServer(1022): About to register with Master. 2023-10-01 22:01:21,981 INFO [RS:1;jenkins-hbase4:37145] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40311,1696197679483 with isa=jenkins-hbase4.apache.org/172.31.14.131:37145, startcode=1696197680825 2023-10-01 22:01:21,981 INFO [RS:2;jenkins-hbase4:39235] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40311,1696197679483 with isa=jenkins-hbase4.apache.org/172.31.14.131:39235, startcode=1696197680862 2023-10-01 22:01:21,981 INFO [RS:0;jenkins-hbase4:42263] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40311,1696197679483 with isa=jenkins-hbase4.apache.org/172.31.14.131:42263, startcode=1696197680774 2023-10-01 22:01:21,999 DEBUG [RS:0;jenkins-hbase4:42263] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-01 22:01:21,999 DEBUG [RS:1;jenkins-hbase4:37145] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-01 22:01:21,999 DEBUG [RS:2;jenkins-hbase4:39235] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-01 22:01:22,037 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-10-01 22:01:22,048 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-01 22:01:22,048 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-01 22:01:22,048 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-01 22:01:22,048 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-01 22:01:22,048 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-10-01 22:01:22,049 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 22:01:22,049 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-01 22:01:22,049 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 22:01:22,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1696197712060 2023-10-01 22:01:22,060 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52665, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-10-01 22:01:22,061 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56091, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-10-01 22:01:22,060 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36075, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-10-01 22:01:22,064 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-10-01 22:01:22,069 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-10-01 22:01:22,070 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-10-01 22:01:22,073 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40311] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-01 22:01:22,075 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-01 22:01:22,077 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-10-01 22:01:22,085 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40311] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-01 22:01:22,087 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40311] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-01 22:01:22,087 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-10-01 22:01:22,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-10-01 22:01:22,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-10-01 22:01:22,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-10-01 22:01:22,091 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-01 22:01:22,092 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-10-01 22:01:22,098 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-10-01 22:01:22,098 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-10-01 22:01:22,105 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-10-01 22:01:22,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-10-01 22:01:22,109 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696197682109,5,FailOnTimeoutGroup] 2023-10-01 22:01:22,110 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696197682109,5,FailOnTimeoutGroup] 2023-10-01 22:01:22,110 DEBUG [RS:1;jenkins-hbase4:37145] regionserver.HRegionServer(2830): Master is not running yet 2023-10-01 22:01:22,110 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-01 22:01:22,110 WARN [RS:1;jenkins-hbase4:37145] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-01 22:01:22,110 DEBUG [RS:0;jenkins-hbase4:42263] regionserver.HRegionServer(2830): Master is not running yet 2023-10-01 22:01:22,111 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-10-01 22:01:22,110 DEBUG [RS:2;jenkins-hbase4:39235] regionserver.HRegionServer(2830): Master is not running yet 2023-10-01 22:01:22,111 WARN [RS:0;jenkins-hbase4:42263] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-01 22:01:22,111 WARN [RS:2;jenkins-hbase4:39235] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-01 22:01:22,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-10-01 22:01:22,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-10-01 22:01:22,127 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-01 22:01:22,128 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-01 22:01:22,129 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9 2023-10-01 22:01:22,150 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:01:22,153 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-01 22:01:22,155 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/meta/1588230740/info 2023-10-01 22:01:22,156 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-01 22:01:22,157 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 22:01:22,157 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-01 22:01:22,159 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/meta/1588230740/rep_barrier 2023-10-01 22:01:22,160 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-01 22:01:22,160 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 22:01:22,161 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-01 22:01:22,163 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/meta/1588230740/table 2023-10-01 22:01:22,163 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-01 22:01:22,164 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 22:01:22,165 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/meta/1588230740 2023-10-01 22:01:22,166 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/meta/1588230740 2023-10-01 22:01:22,170 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-01 22:01:22,173 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-01 22:01:22,179 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 22:01:22,180 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71412610, jitterRate=0.06413081288337708}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-01 22:01:22,180 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-01 22:01:22,180 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-01 22:01:22,180 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-01 22:01:22,181 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-01 22:01:22,181 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-01 22:01:22,181 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-01 22:01:22,183 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-01 22:01:22,183 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-01 22:01:22,189 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-10-01 22:01:22,189 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-10-01 22:01:22,202 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-10-01 22:01:22,212 INFO [RS:1;jenkins-hbase4:37145] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40311,1696197679483 with isa=jenkins-hbase4.apache.org/172.31.14.131:37145, startcode=1696197680825 2023-10-01 22:01:22,212 INFO [RS:0;jenkins-hbase4:42263] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40311,1696197679483 with isa=jenkins-hbase4.apache.org/172.31.14.131:42263, startcode=1696197680774 2023-10-01 22:01:22,212 INFO [RS:2;jenkins-hbase4:39235] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40311,1696197679483 with isa=jenkins-hbase4.apache.org/172.31.14.131:39235, startcode=1696197680862 2023-10-01 22:01:22,219 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40311] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:22,221 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-10-01 22:01:22,226 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40311] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:22,227 DEBUG [RS:1;jenkins-hbase4:37145] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9 2023-10-01 22:01:22,227 DEBUG [RS:1;jenkins-hbase4:37145] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36919 2023-10-01 22:01:22,227 DEBUG [RS:1;jenkins-hbase4:37145] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-01 22:01:22,232 DEBUG [RS:0;jenkins-hbase4:42263] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9 2023-10-01 22:01:22,232 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40311] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:22,232 DEBUG [RS:0;jenkins-hbase4:42263] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36919 2023-10-01 22:01:22,232 DEBUG [RS:0;jenkins-hbase4:42263] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-01 22:01:22,233 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 22:01:22,233 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-10-01 22:01:22,236 DEBUG [RS:2;jenkins-hbase4:39235] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9 2023-10-01 22:01:22,236 DEBUG [RS:2;jenkins-hbase4:39235] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36919 2023-10-01 22:01:22,236 DEBUG [RS:2;jenkins-hbase4:39235] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-01 22:01:22,244 DEBUG [RS:1;jenkins-hbase4:37145] zookeeper.ZKUtil(162): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:22,244 WARN [RS:1;jenkins-hbase4:37145] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-01 22:01:22,244 INFO [RS:1;jenkins-hbase4:37145] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-01 22:01:22,244 DEBUG [RS:1;jenkins-hbase4:37145] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/WALs/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:22,244 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42263,1696197680774] 2023-10-01 22:01:22,244 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37145,1696197680825] 2023-10-01 22:01:22,245 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 22:01:22,245 DEBUG [RS:0;jenkins-hbase4:42263] zookeeper.ZKUtil(162): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:22,245 WARN [RS:0;jenkins-hbase4:42263] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-01 22:01:22,247 INFO [RS:0;jenkins-hbase4:42263] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-01 22:01:22,247 DEBUG [RS:2;jenkins-hbase4:39235] zookeeper.ZKUtil(162): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:22,247 DEBUG [RS:0;jenkins-hbase4:42263] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/WALs/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:22,247 WARN [RS:2;jenkins-hbase4:39235] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-01 22:01:22,247 INFO [RS:2;jenkins-hbase4:39235] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-01 22:01:22,248 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39235,1696197680862] 2023-10-01 22:01:22,248 DEBUG [RS:2;jenkins-hbase4:39235] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/WALs/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:22,261 DEBUG [RS:1;jenkins-hbase4:37145] zookeeper.ZKUtil(162): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:22,261 DEBUG [RS:2;jenkins-hbase4:39235] zookeeper.ZKUtil(162): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:22,261 DEBUG [RS:0;jenkins-hbase4:42263] zookeeper.ZKUtil(162): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:22,261 DEBUG [RS:1;jenkins-hbase4:37145] zookeeper.ZKUtil(162): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:22,261 DEBUG [RS:2;jenkins-hbase4:39235] zookeeper.ZKUtil(162): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:22,261 DEBUG [RS:0;jenkins-hbase4:42263] zookeeper.ZKUtil(162): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:22,262 DEBUG [RS:1;jenkins-hbase4:37145] zookeeper.ZKUtil(162): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:22,262 DEBUG [RS:2;jenkins-hbase4:39235] zookeeper.ZKUtil(162): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:22,263 DEBUG [RS:0;jenkins-hbase4:42263] zookeeper.ZKUtil(162): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:22,273 DEBUG [RS:1;jenkins-hbase4:37145] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-01 22:01:22,273 DEBUG [RS:2;jenkins-hbase4:39235] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-01 22:01:22,273 DEBUG [RS:0;jenkins-hbase4:42263] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-01 22:01:22,283 INFO [RS:1;jenkins-hbase4:37145] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-01 22:01:22,284 INFO [RS:2;jenkins-hbase4:39235] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-01 22:01:22,283 INFO [RS:0;jenkins-hbase4:42263] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-01 22:01:22,305 INFO [RS:0;jenkins-hbase4:42263] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-01 22:01:22,305 INFO [RS:2;jenkins-hbase4:39235] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-01 22:01:22,305 INFO [RS:1;jenkins-hbase4:37145] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-01 22:01:22,312 INFO [RS:1;jenkins-hbase4:37145] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-01 22:01:22,312 INFO [RS:2;jenkins-hbase4:39235] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-01 22:01:22,312 INFO [RS:0;jenkins-hbase4:42263] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-01 22:01:22,313 INFO [RS:2;jenkins-hbase4:39235] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 22:01:22,312 INFO [RS:1;jenkins-hbase4:37145] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 22:01:22,313 INFO [RS:0;jenkins-hbase4:42263] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 22:01:22,314 INFO [RS:0;jenkins-hbase4:42263] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-01 22:01:22,314 INFO [RS:2;jenkins-hbase4:39235] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-01 22:01:22,314 INFO [RS:1;jenkins-hbase4:37145] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-01 22:01:22,322 INFO [RS:0;jenkins-hbase4:42263] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-01 22:01:22,322 INFO [RS:1;jenkins-hbase4:37145] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-01 22:01:22,322 INFO [RS:2;jenkins-hbase4:39235] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-01 22:01:22,323 DEBUG [RS:0;jenkins-hbase4:42263] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 22:01:22,323 DEBUG [RS:1;jenkins-hbase4:37145] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 22:01:22,323 DEBUG [RS:0;jenkins-hbase4:42263] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 22:01:22,323 DEBUG [RS:2;jenkins-hbase4:39235] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 22:01:22,323 DEBUG [RS:0;jenkins-hbase4:42263] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 22:01:22,323 DEBUG [RS:2;jenkins-hbase4:39235] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 22:01:22,323 DEBUG [RS:0;jenkins-hbase4:42263] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 22:01:22,324 DEBUG [RS:2;jenkins-hbase4:39235] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 22:01:22,324 DEBUG [RS:0;jenkins-hbase4:42263] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 22:01:22,324 DEBUG [RS:2;jenkins-hbase4:39235] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 22:01:22,324 DEBUG [RS:0;jenkins-hbase4:42263] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-01 22:01:22,324 DEBUG [RS:2;jenkins-hbase4:39235] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 22:01:22,324 DEBUG [RS:0;jenkins-hbase4:42263] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 22:01:22,324 DEBUG [RS:2;jenkins-hbase4:39235] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-01 22:01:22,323 DEBUG [RS:1;jenkins-hbase4:37145] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 22:01:22,324 DEBUG [RS:2;jenkins-hbase4:39235] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 22:01:22,324 DEBUG [RS:0;jenkins-hbase4:42263] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 22:01:22,324 DEBUG [RS:2;jenkins-hbase4:39235] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 22:01:22,324 DEBUG [RS:0;jenkins-hbase4:42263] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 22:01:22,324 DEBUG [RS:2;jenkins-hbase4:39235] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 22:01:22,324 DEBUG [RS:0;jenkins-hbase4:42263] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 22:01:22,324 DEBUG [RS:2;jenkins-hbase4:39235] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 22:01:22,324 DEBUG [RS:1;jenkins-hbase4:37145] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 22:01:22,325 DEBUG [RS:1;jenkins-hbase4:37145] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 22:01:22,326 DEBUG [RS:1;jenkins-hbase4:37145] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 22:01:22,326 DEBUG [RS:1;jenkins-hbase4:37145] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-01 22:01:22,326 DEBUG [RS:1;jenkins-hbase4:37145] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 22:01:22,326 DEBUG [RS:1;jenkins-hbase4:37145] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 22:01:22,326 DEBUG [RS:1;jenkins-hbase4:37145] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 22:01:22,326 DEBUG [RS:1;jenkins-hbase4:37145] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 22:01:22,326 INFO [RS:2;jenkins-hbase4:39235] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-01 22:01:22,326 INFO [RS:2;jenkins-hbase4:39235] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-01 22:01:22,326 INFO [RS:2;jenkins-hbase4:39235] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-01 22:01:22,329 INFO [RS:0;jenkins-hbase4:42263] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-01 22:01:22,329 INFO [RS:0;jenkins-hbase4:42263] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-01 22:01:22,329 INFO [RS:0;jenkins-hbase4:42263] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-01 22:01:22,329 INFO [RS:1;jenkins-hbase4:37145] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-01 22:01:22,329 INFO [RS:1;jenkins-hbase4:37145] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-01 22:01:22,329 INFO [RS:1;jenkins-hbase4:37145] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-01 22:01:22,347 INFO [RS:2;jenkins-hbase4:39235] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-01 22:01:22,347 INFO [RS:0;jenkins-hbase4:42263] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-01 22:01:22,347 INFO [RS:1;jenkins-hbase4:37145] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-01 22:01:22,351 INFO [RS:1;jenkins-hbase4:37145] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37145,1696197680825-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 22:01:22,351 INFO [RS:2;jenkins-hbase4:39235] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39235,1696197680862-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 22:01:22,351 INFO [RS:0;jenkins-hbase4:42263] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42263,1696197680774-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 22:01:22,374 INFO [RS:1;jenkins-hbase4:37145] regionserver.Replication(203): jenkins-hbase4.apache.org,37145,1696197680825 started 2023-10-01 22:01:22,374 INFO [RS:0;jenkins-hbase4:42263] regionserver.Replication(203): jenkins-hbase4.apache.org,42263,1696197680774 started 2023-10-01 22:01:22,375 INFO [RS:2;jenkins-hbase4:39235] regionserver.Replication(203): jenkins-hbase4.apache.org,39235,1696197680862 started 2023-10-01 22:01:22,375 INFO [RS:1;jenkins-hbase4:37145] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,37145,1696197680825, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37145, sessionid=0x1010401cd730002 2023-10-01 22:01:22,375 INFO [RS:2;jenkins-hbase4:39235] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39235,1696197680862, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39235, sessionid=0x1010401cd730003 2023-10-01 22:01:22,375 INFO [RS:0;jenkins-hbase4:42263] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,42263,1696197680774, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42263, sessionid=0x1010401cd730001 2023-10-01 22:01:22,375 DEBUG [RS:2;jenkins-hbase4:39235] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-01 22:01:22,375 DEBUG [RS:0;jenkins-hbase4:42263] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-01 22:01:22,375 DEBUG [RS:1;jenkins-hbase4:37145] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-01 22:01:22,376 DEBUG [RS:1;jenkins-hbase4:37145] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:22,375 DEBUG [RS:0;jenkins-hbase4:42263] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:22,375 DEBUG [RS:2;jenkins-hbase4:39235] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:22,376 DEBUG [RS:2;jenkins-hbase4:39235] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39235,1696197680862' 2023-10-01 22:01:22,376 DEBUG [RS:0;jenkins-hbase4:42263] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42263,1696197680774' 2023-10-01 22:01:22,376 DEBUG [RS:1;jenkins-hbase4:37145] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37145,1696197680825' 2023-10-01 22:01:22,377 DEBUG [RS:1;jenkins-hbase4:37145] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-01 22:01:22,377 DEBUG [RS:0;jenkins-hbase4:42263] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-01 22:01:22,377 DEBUG [RS:2;jenkins-hbase4:39235] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-01 22:01:22,378 DEBUG [RS:1;jenkins-hbase4:37145] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-01 22:01:22,378 DEBUG [RS:0;jenkins-hbase4:42263] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-01 22:01:22,378 DEBUG [RS:2;jenkins-hbase4:39235] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-01 22:01:22,378 DEBUG [RS:1;jenkins-hbase4:37145] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-01 22:01:22,378 DEBUG [RS:2;jenkins-hbase4:39235] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-01 22:01:22,378 DEBUG [RS:0;jenkins-hbase4:42263] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-01 22:01:22,379 DEBUG [RS:2;jenkins-hbase4:39235] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-01 22:01:22,378 DEBUG [RS:1;jenkins-hbase4:37145] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-01 22:01:22,379 DEBUG [RS:2;jenkins-hbase4:39235] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:22,379 DEBUG [RS:1;jenkins-hbase4:37145] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:22,379 DEBUG [RS:0;jenkins-hbase4:42263] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-01 22:01:22,379 DEBUG [RS:1;jenkins-hbase4:37145] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37145,1696197680825' 2023-10-01 22:01:22,379 DEBUG [RS:1;jenkins-hbase4:37145] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:01:22,379 DEBUG [RS:2;jenkins-hbase4:39235] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39235,1696197680862' 2023-10-01 22:01:22,379 DEBUG [RS:2;jenkins-hbase4:39235] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:01:22,379 DEBUG [RS:0;jenkins-hbase4:42263] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:22,380 DEBUG [RS:0;jenkins-hbase4:42263] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42263,1696197680774' 2023-10-01 22:01:22,380 DEBUG [RS:0;jenkins-hbase4:42263] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:01:22,380 DEBUG [RS:1;jenkins-hbase4:37145] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:01:22,380 DEBUG [RS:2;jenkins-hbase4:39235] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:01:22,380 DEBUG [RS:0;jenkins-hbase4:42263] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:01:22,381 DEBUG [RS:1;jenkins-hbase4:37145] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-01 22:01:22,381 DEBUG [RS:2;jenkins-hbase4:39235] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-01 22:01:22,381 INFO [RS:1;jenkins-hbase4:37145] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-01 22:01:22,381 INFO [RS:2;jenkins-hbase4:39235] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-01 22:01:22,381 DEBUG [RS:0;jenkins-hbase4:42263] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-01 22:01:22,381 INFO [RS:2;jenkins-hbase4:39235] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-01 22:01:22,381 INFO [RS:1;jenkins-hbase4:37145] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-01 22:01:22,382 INFO [RS:0;jenkins-hbase4:42263] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-01 22:01:22,382 INFO [RS:0;jenkins-hbase4:42263] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-01 22:01:22,386 DEBUG [jenkins-hbase4:40311] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-10-01 22:01:22,391 DEBUG [jenkins-hbase4:40311] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 22:01:22,398 DEBUG [jenkins-hbase4:40311] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 22:01:22,398 DEBUG [jenkins-hbase4:40311] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 22:01:22,399 DEBUG [jenkins-hbase4:40311] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 22:01:22,399 DEBUG [jenkins-hbase4:40311] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 22:01:22,402 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42263,1696197680774, state=OPENING 2023-10-01 22:01:22,409 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-10-01 22:01:22,411 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 22:01:22,411 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-01 22:01:22,415 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42263,1696197680774}] 2023-10-01 22:01:22,493 INFO [RS:2;jenkins-hbase4:39235] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39235%2C1696197680862, suffix=, logDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/WALs/jenkins-hbase4.apache.org,39235,1696197680862, archiveDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/oldWALs, maxLogs=32 2023-10-01 22:01:22,493 INFO [RS:0;jenkins-hbase4:42263] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42263%2C1696197680774, suffix=, logDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/WALs/jenkins-hbase4.apache.org,42263,1696197680774, archiveDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/oldWALs, maxLogs=32 2023-10-01 22:01:22,493 INFO [RS:1;jenkins-hbase4:37145] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37145%2C1696197680825, suffix=, logDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/WALs/jenkins-hbase4.apache.org,37145,1696197680825, archiveDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/oldWALs, maxLogs=32 2023-10-01 22:01:22,520 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44265,DS-9f26927d-96bd-4e3e-af39-de2712fcd991,DISK] 2023-10-01 22:01:22,520 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44265,DS-9f26927d-96bd-4e3e-af39-de2712fcd991,DISK] 2023-10-01 22:01:22,520 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32835,DS-89e8b865-52b2-4372-8d32-51fa3f7c6769,DISK] 2023-10-01 22:01:22,520 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41221,DS-ddd95b61-9f87-4546-9d26-0b3f08890a6a,DISK] 2023-10-01 22:01:22,520 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41221,DS-ddd95b61-9f87-4546-9d26-0b3f08890a6a,DISK] 2023-10-01 22:01:22,521 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32835,DS-89e8b865-52b2-4372-8d32-51fa3f7c6769,DISK] 2023-10-01 22:01:22,530 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32835,DS-89e8b865-52b2-4372-8d32-51fa3f7c6769,DISK] 2023-10-01 22:01:22,530 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41221,DS-ddd95b61-9f87-4546-9d26-0b3f08890a6a,DISK] 2023-10-01 22:01:22,530 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44265,DS-9f26927d-96bd-4e3e-af39-de2712fcd991,DISK] 2023-10-01 22:01:22,539 INFO [RS:2;jenkins-hbase4:39235] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/WALs/jenkins-hbase4.apache.org,39235,1696197680862/jenkins-hbase4.apache.org%2C39235%2C1696197680862.1696197682497 2023-10-01 22:01:22,539 INFO [RS:1;jenkins-hbase4:37145] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/WALs/jenkins-hbase4.apache.org,37145,1696197680825/jenkins-hbase4.apache.org%2C37145%2C1696197680825.1696197682497 2023-10-01 22:01:22,539 INFO [RS:0;jenkins-hbase4:42263] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/WALs/jenkins-hbase4.apache.org,42263,1696197680774/jenkins-hbase4.apache.org%2C42263%2C1696197680774.1696197682498 2023-10-01 22:01:22,540 DEBUG [RS:2;jenkins-hbase4:39235] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44265,DS-9f26927d-96bd-4e3e-af39-de2712fcd991,DISK], DatanodeInfoWithStorage[127.0.0.1:41221,DS-ddd95b61-9f87-4546-9d26-0b3f08890a6a,DISK], DatanodeInfoWithStorage[127.0.0.1:32835,DS-89e8b865-52b2-4372-8d32-51fa3f7c6769,DISK]] 2023-10-01 22:01:22,542 DEBUG [RS:1;jenkins-hbase4:37145] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44265,DS-9f26927d-96bd-4e3e-af39-de2712fcd991,DISK], DatanodeInfoWithStorage[127.0.0.1:41221,DS-ddd95b61-9f87-4546-9d26-0b3f08890a6a,DISK], DatanodeInfoWithStorage[127.0.0.1:32835,DS-89e8b865-52b2-4372-8d32-51fa3f7c6769,DISK]] 2023-10-01 22:01:22,542 DEBUG [RS:0;jenkins-hbase4:42263] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41221,DS-ddd95b61-9f87-4546-9d26-0b3f08890a6a,DISK], DatanodeInfoWithStorage[127.0.0.1:32835,DS-89e8b865-52b2-4372-8d32-51fa3f7c6769,DISK], DatanodeInfoWithStorage[127.0.0.1:44265,DS-9f26927d-96bd-4e3e-af39-de2712fcd991,DISK]] 2023-10-01 22:01:22,601 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:22,603 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-01 22:01:22,606 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44528, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-01 22:01:22,619 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-10-01 22:01:22,619 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-01 22:01:22,622 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42263%2C1696197680774.meta, suffix=.meta, logDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/WALs/jenkins-hbase4.apache.org,42263,1696197680774, archiveDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/oldWALs, maxLogs=32 2023-10-01 22:01:22,641 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32835,DS-89e8b865-52b2-4372-8d32-51fa3f7c6769,DISK] 2023-10-01 22:01:22,642 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41221,DS-ddd95b61-9f87-4546-9d26-0b3f08890a6a,DISK] 2023-10-01 22:01:22,644 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44265,DS-9f26927d-96bd-4e3e-af39-de2712fcd991,DISK] 2023-10-01 22:01:22,652 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/WALs/jenkins-hbase4.apache.org,42263,1696197680774/jenkins-hbase4.apache.org%2C42263%2C1696197680774.meta.1696197682623.meta 2023-10-01 22:01:22,655 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32835,DS-89e8b865-52b2-4372-8d32-51fa3f7c6769,DISK], DatanodeInfoWithStorage[127.0.0.1:41221,DS-ddd95b61-9f87-4546-9d26-0b3f08890a6a,DISK], DatanodeInfoWithStorage[127.0.0.1:44265,DS-9f26927d-96bd-4e3e-af39-de2712fcd991,DISK]] 2023-10-01 22:01:22,656 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-10-01 22:01:22,657 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-10-01 22:01:22,658 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 22:01:22,659 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-10-01 22:01:22,662 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-10-01 22:01:22,664 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-10-01 22:01:22,677 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-10-01 22:01:22,678 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:01:22,678 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-10-01 22:01:22,678 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-10-01 22:01:22,681 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-01 22:01:22,682 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/meta/1588230740/info 2023-10-01 22:01:22,683 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/meta/1588230740/info 2023-10-01 22:01:22,683 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-01 22:01:22,684 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 22:01:22,685 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-01 22:01:22,686 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/meta/1588230740/rep_barrier 2023-10-01 22:01:22,686 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/meta/1588230740/rep_barrier 2023-10-01 22:01:22,687 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-01 22:01:22,688 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 22:01:22,688 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-01 22:01:22,690 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/meta/1588230740/table 2023-10-01 22:01:22,690 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/meta/1588230740/table 2023-10-01 22:01:22,691 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-01 22:01:22,692 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 22:01:22,693 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/meta/1588230740 2023-10-01 22:01:22,696 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/meta/1588230740 2023-10-01 22:01:22,700 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-01 22:01:22,702 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-01 22:01:22,704 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74177654, jitterRate=0.10533317923545837}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-01 22:01:22,706 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-01 22:01:22,717 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1696197682593 2023-10-01 22:01:22,736 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-10-01 22:01:22,737 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-10-01 22:01:22,737 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42263,1696197680774, state=OPEN 2023-10-01 22:01:22,741 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-10-01 22:01:22,742 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-01 22:01:22,746 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-10-01 22:01:22,746 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42263,1696197680774 in 327 msec 2023-10-01 22:01:22,751 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-10-01 22:01:22,751 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 545 msec 2023-10-01 22:01:22,756 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 801 msec 2023-10-01 22:01:22,756 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1696197682756, completionTime=-1 2023-10-01 22:01:22,756 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-10-01 22:01:22,756 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-10-01 22:01:22,826 DEBUG [hconnection-0x6cc451db-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:01:22,829 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44534, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:01:22,849 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-10-01 22:01:22,849 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1696197742849 2023-10-01 22:01:22,849 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1696197802849 2023-10-01 22:01:22,849 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 92 msec 2023-10-01 22:01:22,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40311,1696197679483-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 22:01:22,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40311,1696197679483-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-01 22:01:22,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40311,1696197679483-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-01 22:01:22,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40311, period=300000, unit=MILLISECONDS is enabled. 2023-10-01 22:01:22,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-10-01 22:01:22,887 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-10-01 22:01:22,896 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-10-01 22:01:22,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-01 22:01:22,907 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-10-01 22:01:22,910 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 22:01:22,913 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 22:01:22,935 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/hbase/namespace/62f2c814ef3efb99d2c6171ce3348ce0 2023-10-01 22:01:22,938 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/hbase/namespace/62f2c814ef3efb99d2c6171ce3348ce0 empty. 2023-10-01 22:01:22,939 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/hbase/namespace/62f2c814ef3efb99d2c6171ce3348ce0 2023-10-01 22:01:22,939 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-10-01 22:01:22,986 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-10-01 22:01:22,988 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 62f2c814ef3efb99d2c6171ce3348ce0, NAME => 'hbase:namespace,,1696197682897.62f2c814ef3efb99d2c6171ce3348ce0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp 2023-10-01 22:01:23,006 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696197682897.62f2c814ef3efb99d2c6171ce3348ce0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:01:23,007 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 62f2c814ef3efb99d2c6171ce3348ce0, disabling compactions & flushes 2023-10-01 22:01:23,007 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696197682897.62f2c814ef3efb99d2c6171ce3348ce0. 2023-10-01 22:01:23,007 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696197682897.62f2c814ef3efb99d2c6171ce3348ce0. 2023-10-01 22:01:23,007 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696197682897.62f2c814ef3efb99d2c6171ce3348ce0. after waiting 0 ms 2023-10-01 22:01:23,007 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696197682897.62f2c814ef3efb99d2c6171ce3348ce0. 2023-10-01 22:01:23,007 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696197682897.62f2c814ef3efb99d2c6171ce3348ce0. 2023-10-01 22:01:23,007 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 62f2c814ef3efb99d2c6171ce3348ce0: 2023-10-01 22:01:23,011 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 22:01:23,026 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1696197682897.62f2c814ef3efb99d2c6171ce3348ce0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696197683014"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696197683014"}]},"ts":"1696197683014"} 2023-10-01 22:01:23,052 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-01 22:01:23,054 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 22:01:23,058 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696197683054"}]},"ts":"1696197683054"} 2023-10-01 22:01:23,062 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-10-01 22:01:23,067 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 22:01:23,068 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 22:01:23,068 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 22:01:23,068 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 22:01:23,068 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 22:01:23,071 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=62f2c814ef3efb99d2c6171ce3348ce0, ASSIGN}] 2023-10-01 22:01:23,073 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=62f2c814ef3efb99d2c6171ce3348ce0, ASSIGN 2023-10-01 22:01:23,075 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=62f2c814ef3efb99d2c6171ce3348ce0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37145,1696197680825; forceNewPlan=false, retain=false 2023-10-01 22:01:23,228 INFO [jenkins-hbase4:40311] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-01 22:01:23,229 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=62f2c814ef3efb99d2c6171ce3348ce0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:23,229 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1696197682897.62f2c814ef3efb99d2c6171ce3348ce0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696197683228"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696197683228"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696197683228"}]},"ts":"1696197683228"} 2023-10-01 22:01:23,233 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 62f2c814ef3efb99d2c6171ce3348ce0, server=jenkins-hbase4.apache.org,37145,1696197680825}] 2023-10-01 22:01:23,389 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:23,389 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-01 22:01:23,392 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48068, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-01 22:01:23,398 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1696197682897.62f2c814ef3efb99d2c6171ce3348ce0. 2023-10-01 22:01:23,398 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 62f2c814ef3efb99d2c6171ce3348ce0, NAME => 'hbase:namespace,,1696197682897.62f2c814ef3efb99d2c6171ce3348ce0.', STARTKEY => '', ENDKEY => ''} 2023-10-01 22:01:23,399 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1696197682897.62f2c814ef3efb99d2c6171ce3348ce0. service=AccessControlService 2023-10-01 22:01:23,399 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 22:01:23,400 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 62f2c814ef3efb99d2c6171ce3348ce0 2023-10-01 22:01:23,400 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696197682897.62f2c814ef3efb99d2c6171ce3348ce0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:01:23,400 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 62f2c814ef3efb99d2c6171ce3348ce0 2023-10-01 22:01:23,400 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 62f2c814ef3efb99d2c6171ce3348ce0 2023-10-01 22:01:23,402 INFO [StoreOpener-62f2c814ef3efb99d2c6171ce3348ce0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 62f2c814ef3efb99d2c6171ce3348ce0 2023-10-01 22:01:23,405 DEBUG [StoreOpener-62f2c814ef3efb99d2c6171ce3348ce0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/namespace/62f2c814ef3efb99d2c6171ce3348ce0/info 2023-10-01 22:01:23,405 DEBUG [StoreOpener-62f2c814ef3efb99d2c6171ce3348ce0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/namespace/62f2c814ef3efb99d2c6171ce3348ce0/info 2023-10-01 22:01:23,405 INFO [StoreOpener-62f2c814ef3efb99d2c6171ce3348ce0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 62f2c814ef3efb99d2c6171ce3348ce0 columnFamilyName info 2023-10-01 22:01:23,406 INFO [StoreOpener-62f2c814ef3efb99d2c6171ce3348ce0-1] regionserver.HStore(310): Store=62f2c814ef3efb99d2c6171ce3348ce0/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 22:01:23,408 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/namespace/62f2c814ef3efb99d2c6171ce3348ce0 2023-10-01 22:01:23,409 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/namespace/62f2c814ef3efb99d2c6171ce3348ce0 2023-10-01 22:01:23,413 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 62f2c814ef3efb99d2c6171ce3348ce0 2023-10-01 22:01:23,416 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/namespace/62f2c814ef3efb99d2c6171ce3348ce0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 22:01:23,417 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 62f2c814ef3efb99d2c6171ce3348ce0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75402046, jitterRate=0.1235780417919159}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 22:01:23,417 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 62f2c814ef3efb99d2c6171ce3348ce0: 2023-10-01 22:01:23,419 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1696197682897.62f2c814ef3efb99d2c6171ce3348ce0., pid=6, masterSystemTime=1696197683388 2023-10-01 22:01:23,424 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1696197682897.62f2c814ef3efb99d2c6171ce3348ce0. 2023-10-01 22:01:23,424 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1696197682897.62f2c814ef3efb99d2c6171ce3348ce0. 2023-10-01 22:01:23,429 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=62f2c814ef3efb99d2c6171ce3348ce0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:23,430 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1696197682897.62f2c814ef3efb99d2c6171ce3348ce0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696197683429"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696197683429"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696197683429"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696197683429"}]},"ts":"1696197683429"} 2023-10-01 22:01:23,439 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-10-01 22:01:23,439 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 62f2c814ef3efb99d2c6171ce3348ce0, server=jenkins-hbase4.apache.org,37145,1696197680825 in 202 msec 2023-10-01 22:01:23,445 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-10-01 22:01:23,446 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=62f2c814ef3efb99d2c6171ce3348ce0, ASSIGN in 368 msec 2023-10-01 22:01:23,448 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 22:01:23,448 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696197683448"}]},"ts":"1696197683448"} 2023-10-01 22:01:23,450 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-10-01 22:01:23,453 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 22:01:23,456 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 555 msec 2023-10-01 22:01:23,510 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-10-01 22:01:23,511 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-10-01 22:01:23,511 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 22:01:23,532 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:01:23,535 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48078, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:01:23,552 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-10-01 22:01:23,569 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-01 22:01:23,577 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 36 msec 2023-10-01 22:01:23,585 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-10-01 22:01:23,596 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-01 22:01:23,601 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 14 msec 2023-10-01 22:01:23,611 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-10-01 22:01:23,613 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-10-01 22:01:23,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.687sec 2023-10-01 22:01:23,616 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-10-01 22:01:23,618 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-10-01 22:01:23,618 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-10-01 22:01:23,619 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40311,1696197679483-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-10-01 22:01:23,620 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40311,1696197679483-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-10-01 22:01:23,639 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-01 22:01:23,641 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-10-01 22:01:23,643 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 22:01:23,644 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 22:01:23,647 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-10-01 22:01:23,647 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/hbase/acl/4910acaf33428285af586d76cbf2f7ce 2023-10-01 22:01:23,648 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/hbase/acl/4910acaf33428285af586d76cbf2f7ce empty. 2023-10-01 22:01:23,650 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/hbase/acl/4910acaf33428285af586d76cbf2f7ce 2023-10-01 22:01:23,650 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-10-01 22:01:23,654 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-01 22:01:23,672 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-10-01 22:01:23,674 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4910acaf33428285af586d76cbf2f7ce, NAME => 'hbase:acl,,1696197683635.4910acaf33428285af586d76cbf2f7ce.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp 2023-10-01 22:01:23,693 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696197683635.4910acaf33428285af586d76cbf2f7ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:01:23,693 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 4910acaf33428285af586d76cbf2f7ce, disabling compactions & flushes 2023-10-01 22:01:23,693 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696197683635.4910acaf33428285af586d76cbf2f7ce. 2023-10-01 22:01:23,693 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696197683635.4910acaf33428285af586d76cbf2f7ce. 2023-10-01 22:01:23,693 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696197683635.4910acaf33428285af586d76cbf2f7ce. after waiting 0 ms 2023-10-01 22:01:23,694 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696197683635.4910acaf33428285af586d76cbf2f7ce. 2023-10-01 22:01:23,694 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1696197683635.4910acaf33428285af586d76cbf2f7ce. 2023-10-01 22:01:23,694 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 4910acaf33428285af586d76cbf2f7ce: 2023-10-01 22:01:23,698 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 22:01:23,700 DEBUG [Listener at localhost/38397] zookeeper.ReadOnlyZKClient(139): Connect 0x4f3f5cbd to 127.0.0.1:58905 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 22:01:23,700 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1696197683635.4910acaf33428285af586d76cbf2f7ce.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696197683700"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696197683700"}]},"ts":"1696197683700"} 2023-10-01 22:01:23,704 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-01 22:01:23,704 DEBUG [Listener at localhost/38397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d513f0e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 22:01:23,706 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 22:01:23,706 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696197683706"}]},"ts":"1696197683706"} 2023-10-01 22:01:23,709 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-10-01 22:01:23,714 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 22:01:23,715 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 22:01:23,715 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 22:01:23,715 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 22:01:23,715 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 22:01:23,715 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=4910acaf33428285af586d76cbf2f7ce, ASSIGN}] 2023-10-01 22:01:23,718 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=4910acaf33428285af586d76cbf2f7ce, ASSIGN 2023-10-01 22:01:23,719 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=4910acaf33428285af586d76cbf2f7ce, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37145,1696197680825; forceNewPlan=false, retain=false 2023-10-01 22:01:23,723 DEBUG [hconnection-0x719aedd4-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:01:23,734 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44536, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:01:23,737 INFO [Listener at localhost/38397] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40311,1696197679483 2023-10-01 22:01:23,737 INFO [Listener at localhost/38397] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-10-01 22:01:23,737 INFO [Listener at localhost/38397] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/test.cache.data in system properties and HBase conf 2023-10-01 22:01:23,737 INFO [Listener at localhost/38397] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/hadoop.tmp.dir in system properties and HBase conf 2023-10-01 22:01:23,737 INFO [Listener at localhost/38397] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/hadoop.log.dir in system properties and HBase conf 2023-10-01 22:01:23,737 INFO [Listener at localhost/38397] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-01 22:01:23,737 INFO [Listener at localhost/38397] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-01 22:01:23,737 INFO [Listener at localhost/38397] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-01 22:01:23,737 INFO [Listener at localhost/38397] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-01 22:01:23,737 INFO [Listener at localhost/38397] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-01 22:01:23,737 INFO [Listener at localhost/38397] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-01 22:01:23,738 INFO [Listener at localhost/38397] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-01 22:01:23,738 INFO [Listener at localhost/38397] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-01 22:01:23,738 INFO [Listener at localhost/38397] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-01 22:01:23,738 INFO [Listener at localhost/38397] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-01 22:01:23,738 INFO [Listener at localhost/38397] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-01 22:01:23,738 INFO [Listener at localhost/38397] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-01 22:01:23,738 INFO [Listener at localhost/38397] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/nfs.dump.dir in system properties and HBase conf 2023-10-01 22:01:23,738 INFO [Listener at localhost/38397] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/java.io.tmpdir in system properties and HBase conf 2023-10-01 22:01:23,738 INFO [Listener at localhost/38397] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-01 22:01:23,738 INFO [Listener at localhost/38397] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-01 22:01:23,738 INFO [Listener at localhost/38397] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-10-01 22:01:23,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-01 22:01:23,869 INFO [jenkins-hbase4:40311] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-01 22:01:23,870 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=4910acaf33428285af586d76cbf2f7ce, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:23,871 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1696197683635.4910acaf33428285af586d76cbf2f7ce.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696197683870"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696197683870"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696197683870"}]},"ts":"1696197683870"} 2023-10-01 22:01:23,874 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 4910acaf33428285af586d76cbf2f7ce, server=jenkins-hbase4.apache.org,37145,1696197680825}] 2023-10-01 22:01:23,959 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-01 22:01:24,033 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1696197683635.4910acaf33428285af586d76cbf2f7ce. 2023-10-01 22:01:24,034 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4910acaf33428285af586d76cbf2f7ce, NAME => 'hbase:acl,,1696197683635.4910acaf33428285af586d76cbf2f7ce.', STARTKEY => '', ENDKEY => ''} 2023-10-01 22:01:24,034 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1696197683635.4910acaf33428285af586d76cbf2f7ce. service=AccessControlService 2023-10-01 22:01:24,034 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 22:01:24,034 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 4910acaf33428285af586d76cbf2f7ce 2023-10-01 22:01:24,035 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696197683635.4910acaf33428285af586d76cbf2f7ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:01:24,035 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4910acaf33428285af586d76cbf2f7ce 2023-10-01 22:01:24,035 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4910acaf33428285af586d76cbf2f7ce 2023-10-01 22:01:24,037 INFO [StoreOpener-4910acaf33428285af586d76cbf2f7ce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 4910acaf33428285af586d76cbf2f7ce 2023-10-01 22:01:24,039 DEBUG [StoreOpener-4910acaf33428285af586d76cbf2f7ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/acl/4910acaf33428285af586d76cbf2f7ce/l 2023-10-01 22:01:24,039 DEBUG [StoreOpener-4910acaf33428285af586d76cbf2f7ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/acl/4910acaf33428285af586d76cbf2f7ce/l 2023-10-01 22:01:24,040 INFO [StoreOpener-4910acaf33428285af586d76cbf2f7ce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4910acaf33428285af586d76cbf2f7ce columnFamilyName l 2023-10-01 22:01:24,040 INFO [StoreOpener-4910acaf33428285af586d76cbf2f7ce-1] regionserver.HStore(310): Store=4910acaf33428285af586d76cbf2f7ce/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 22:01:24,043 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/acl/4910acaf33428285af586d76cbf2f7ce 2023-10-01 22:01:24,044 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/acl/4910acaf33428285af586d76cbf2f7ce 2023-10-01 22:01:24,050 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4910acaf33428285af586d76cbf2f7ce 2023-10-01 22:01:24,054 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/acl/4910acaf33428285af586d76cbf2f7ce/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 22:01:24,055 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4910acaf33428285af586d76cbf2f7ce; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61697757, jitterRate=-0.08063177764415741}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 22:01:24,055 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4910acaf33428285af586d76cbf2f7ce: 2023-10-01 22:01:24,057 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1696197683635.4910acaf33428285af586d76cbf2f7ce., pid=11, masterSystemTime=1696197684028 2023-10-01 22:01:24,060 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1696197683635.4910acaf33428285af586d76cbf2f7ce. 2023-10-01 22:01:24,060 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1696197683635.4910acaf33428285af586d76cbf2f7ce. 2023-10-01 22:01:24,061 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=4910acaf33428285af586d76cbf2f7ce, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:24,061 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1696197683635.4910acaf33428285af586d76cbf2f7ce.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696197684061"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696197684061"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696197684061"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696197684061"}]},"ts":"1696197684061"} 2023-10-01 22:01:24,068 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-10-01 22:01:24,068 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 4910acaf33428285af586d76cbf2f7ce, server=jenkins-hbase4.apache.org,37145,1696197680825 in 190 msec 2023-10-01 22:01:24,072 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-10-01 22:01:24,072 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=4910acaf33428285af586d76cbf2f7ce, ASSIGN in 353 msec 2023-10-01 22:01:24,074 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 22:01:24,074 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696197684074"}]},"ts":"1696197684074"} 2023-10-01 22:01:24,077 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-10-01 22:01:24,080 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 22:01:24,082 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 441 msec 2023-10-01 22:01:24,259 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-01 22:01:24,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-10-01 22:01:24,268 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-10-01 22:01:25,046 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 22:01:25,405 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 22:01:25,411 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_42031_jobhistory____k161rt/webapp 2023-10-01 22:01:25,580 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-10-01 22:01:25,580 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-10-01 22:01:25,581 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-01 22:01:25,584 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-01 22:01:25,665 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 22:01:25,984 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 22:01:26,269 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-10-01 22:01:26,301 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:42031 2023-10-01 22:01:26,539 WARN [Listener at jenkins-hbase4.apache.org/42223] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 22:01:26,794 WARN [Listener at jenkins-hbase4.apache.org/42223] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-01 22:01:26,795 INFO [Listener at jenkins-hbase4.apache.org/42223] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 22:01:26,803 INFO [Listener at jenkins-hbase4.apache.org/42223] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46195_cluster____41p9bt/webapp 2023-10-01 22:01:26,891 INFO [Listener at jenkins-hbase4.apache.org/42223] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-10-01 22:01:26,892 INFO [Listener at jenkins-hbase4.apache.org/42223] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-10-01 22:01:26,892 INFO [Listener at jenkins-hbase4.apache.org/42223] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-01 22:01:26,892 INFO [Listener at jenkins-hbase4.apache.org/42223] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-01 22:01:26,901 INFO [Listener at jenkins-hbase4.apache.org/42223] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 22:01:27,088 INFO [Listener at jenkins-hbase4.apache.org/42223] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 22:01:27,185 INFO [Listener at jenkins-hbase4.apache.org/42223] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 22:01:27,195 INFO [Listener at jenkins-hbase4.apache.org/42223] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46195 2023-10-01 22:01:27,672 WARN [Listener at jenkins-hbase4.apache.org/37673] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 22:01:27,728 WARN [Listener at jenkins-hbase4.apache.org/37673] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-01 22:01:27,729 INFO [Listener at jenkins-hbase4.apache.org/37673] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 22:01:27,735 INFO [Listener at jenkins-hbase4.apache.org/37673] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44759_node____.bqg84n/webapp 2023-10-01 22:01:27,787 INFO [Listener at jenkins-hbase4.apache.org/37673] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-01 22:01:27,787 INFO [Listener at jenkins-hbase4.apache.org/37673] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-01 22:01:27,787 INFO [Listener at jenkins-hbase4.apache.org/37673] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-01 22:01:27,787 INFO [Listener at jenkins-hbase4.apache.org/37673] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-01 22:01:27,795 INFO [Listener at jenkins-hbase4.apache.org/37673] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 22:01:27,816 INFO [Listener at jenkins-hbase4.apache.org/37673] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 22:01:27,878 INFO [Listener at jenkins-hbase4.apache.org/37673] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 22:01:27,888 INFO [Listener at jenkins-hbase4.apache.org/37673] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44759 2023-10-01 22:01:28,068 WARN [Listener at jenkins-hbase4.apache.org/45715] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 22:01:28,076 WARN [Listener at jenkins-hbase4.apache.org/45715] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-01 22:01:28,077 INFO [Listener at jenkins-hbase4.apache.org/45715] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 22:01:28,084 INFO [Listener at jenkins-hbase4.apache.org/45715] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39781_node____k31zew/webapp 2023-10-01 22:01:28,137 INFO [Listener at jenkins-hbase4.apache.org/45715] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-01 22:01:28,137 INFO [Listener at jenkins-hbase4.apache.org/45715] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-01 22:01:28,137 INFO [Listener at jenkins-hbase4.apache.org/45715] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-01 22:01:28,137 INFO [Listener at jenkins-hbase4.apache.org/45715] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-01 22:01:28,147 INFO [Listener at jenkins-hbase4.apache.org/45715] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 22:01:28,163 INFO [Listener at jenkins-hbase4.apache.org/45715] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 22:01:28,231 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 22:01:28,235 INFO [Listener at jenkins-hbase4.apache.org/45715] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 22:01:28,245 INFO [Listener at jenkins-hbase4.apache.org/45715] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39781 2023-10-01 22:01:28,292 INFO [Listener at jenkins-hbase4.apache.org/45715] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-10-01 22:01:28,294 INFO [Listener at jenkins-hbase4.apache.org/45715] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 22:01:28,374 INFO [Listener at jenkins-hbase4.apache.org/45715] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=705, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=148, ProcessCount=165, AvailableMemoryMB=2409 2023-10-01 22:01:28,374 WARN [Listener at jenkins-hbase4.apache.org/45715] hbase.ResourceChecker(130): Thread=705 is superior to 500 2023-10-01 22:01:28,393 DEBUG [Listener at jenkins-hbase4.apache.org/45715] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-01 22:01:28,400 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56670, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-01 22:01:28,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-01 22:01:28,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-10-01 22:01:28,420 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 22:01:28,425 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-10-01 22:01:28,427 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 22:01:28,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-01 22:01:28,432 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportWithTargetName/6eacfb6280a3a2094b992a056fb091f2 2023-10-01 22:01:28,433 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportWithTargetName/e4df8014675d4cb631774c9051bc866c 2023-10-01 22:01:28,435 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportWithTargetName/6eacfb6280a3a2094b992a056fb091f2 empty. 2023-10-01 22:01:28,436 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportWithTargetName/e4df8014675d4cb631774c9051bc866c empty. 2023-10-01 22:01:28,436 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportWithTargetName/6eacfb6280a3a2094b992a056fb091f2 2023-10-01 22:01:28,436 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportWithTargetName/e4df8014675d4cb631774c9051bc866c 2023-10-01 22:01:28,436 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-01 22:01:28,455 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-10-01 22:01:28,457 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-10-01 22:01:28,459 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-10-01 22:01:28,487 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-10-01 22:01:28,489 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6eacfb6280a3a2094b992a056fb091f2, NAME => 'testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp 2023-10-01 22:01:28,489 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => e4df8014675d4cb631774c9051bc866c, NAME => 'testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp 2023-10-01 22:01:28,532 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:01:28,533 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 6eacfb6280a3a2094b992a056fb091f2, disabling compactions & flushes 2023-10-01 22:01:28,534 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2. 2023-10-01 22:01:28,534 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2. 2023-10-01 22:01:28,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-01 22:01:28,534 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2. after waiting 0 ms 2023-10-01 22:01:28,535 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2. 2023-10-01 22:01:28,535 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2. 2023-10-01 22:01:28,535 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 6eacfb6280a3a2094b992a056fb091f2: 2023-10-01 22:01:28,536 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:01:28,537 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing e4df8014675d4cb631774c9051bc866c, disabling compactions & flushes 2023-10-01 22:01:28,537 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c. 2023-10-01 22:01:28,537 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c. 2023-10-01 22:01:28,537 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c. after waiting 0 ms 2023-10-01 22:01:28,537 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c. 2023-10-01 22:01:28,537 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c. 2023-10-01 22:01:28,537 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for e4df8014675d4cb631774c9051bc866c: 2023-10-01 22:01:28,544 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 22:01:28,545 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696197688545"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696197688545"}]},"ts":"1696197688545"} 2023-10-01 22:01:28,545 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696197688545"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696197688545"}]},"ts":"1696197688545"} 2023-10-01 22:01:28,592 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 22:01:28,594 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 22:01:28,594 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696197688594"}]},"ts":"1696197688594"} 2023-10-01 22:01:28,596 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-10-01 22:01:28,601 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 22:01:28,603 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 22:01:28,603 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 22:01:28,603 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 22:01:28,603 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 22:01:28,603 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=6eacfb6280a3a2094b992a056fb091f2, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e4df8014675d4cb631774c9051bc866c, ASSIGN}] 2023-10-01 22:01:28,606 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=6eacfb6280a3a2094b992a056fb091f2, ASSIGN 2023-10-01 22:01:28,607 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e4df8014675d4cb631774c9051bc866c, ASSIGN 2023-10-01 22:01:28,608 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=6eacfb6280a3a2094b992a056fb091f2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42263,1696197680774; forceNewPlan=false, retain=false 2023-10-01 22:01:28,608 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e4df8014675d4cb631774c9051bc866c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37145,1696197680825; forceNewPlan=false, retain=false 2023-10-01 22:01:28,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-01 22:01:28,758 INFO [jenkins-hbase4:40311] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 22:01:28,761 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=e4df8014675d4cb631774c9051bc866c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:28,761 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=6eacfb6280a3a2094b992a056fb091f2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:28,761 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696197688761"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696197688761"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696197688761"}]},"ts":"1696197688761"} 2023-10-01 22:01:28,761 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696197688761"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696197688761"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696197688761"}]},"ts":"1696197688761"} 2023-10-01 22:01:28,764 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure e4df8014675d4cb631774c9051bc866c, server=jenkins-hbase4.apache.org,37145,1696197680825}] 2023-10-01 22:01:28,765 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 6eacfb6280a3a2094b992a056fb091f2, server=jenkins-hbase4.apache.org,42263,1696197680774}] 2023-10-01 22:01:28,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c. 2023-10-01 22:01:28,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e4df8014675d4cb631774c9051bc866c, NAME => 'testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c.', STARTKEY => '1', ENDKEY => ''} 2023-10-01 22:01:28,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c. service=AccessControlService 2023-10-01 22:01:28,924 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 22:01:28,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName e4df8014675d4cb631774c9051bc866c 2023-10-01 22:01:28,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:01:28,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e4df8014675d4cb631774c9051bc866c 2023-10-01 22:01:28,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e4df8014675d4cb631774c9051bc866c 2023-10-01 22:01:28,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2. 2023-10-01 22:01:28,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6eacfb6280a3a2094b992a056fb091f2, NAME => 'testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2.', STARTKEY => '', ENDKEY => '1'} 2023-10-01 22:01:28,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2. service=AccessControlService 2023-10-01 22:01:28,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 22:01:28,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 6eacfb6280a3a2094b992a056fb091f2 2023-10-01 22:01:28,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:01:28,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6eacfb6280a3a2094b992a056fb091f2 2023-10-01 22:01:28,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6eacfb6280a3a2094b992a056fb091f2 2023-10-01 22:01:28,928 INFO [StoreOpener-e4df8014675d4cb631774c9051bc866c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e4df8014675d4cb631774c9051bc866c 2023-10-01 22:01:28,930 DEBUG [StoreOpener-e4df8014675d4cb631774c9051bc866c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportWithTargetName/e4df8014675d4cb631774c9051bc866c/cf 2023-10-01 22:01:28,931 DEBUG [StoreOpener-e4df8014675d4cb631774c9051bc866c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportWithTargetName/e4df8014675d4cb631774c9051bc866c/cf 2023-10-01 22:01:28,934 INFO [StoreOpener-6eacfb6280a3a2094b992a056fb091f2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6eacfb6280a3a2094b992a056fb091f2 2023-10-01 22:01:28,935 INFO [StoreOpener-e4df8014675d4cb631774c9051bc866c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4df8014675d4cb631774c9051bc866c columnFamilyName cf 2023-10-01 22:01:28,936 DEBUG [StoreOpener-6eacfb6280a3a2094b992a056fb091f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportWithTargetName/6eacfb6280a3a2094b992a056fb091f2/cf 2023-10-01 22:01:28,936 DEBUG [StoreOpener-6eacfb6280a3a2094b992a056fb091f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportWithTargetName/6eacfb6280a3a2094b992a056fb091f2/cf 2023-10-01 22:01:28,937 INFO [StoreOpener-6eacfb6280a3a2094b992a056fb091f2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6eacfb6280a3a2094b992a056fb091f2 columnFamilyName cf 2023-10-01 22:01:28,939 INFO [StoreOpener-e4df8014675d4cb631774c9051bc866c-1] regionserver.HStore(310): Store=e4df8014675d4cb631774c9051bc866c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 22:01:28,940 INFO [StoreOpener-6eacfb6280a3a2094b992a056fb091f2-1] regionserver.HStore(310): Store=6eacfb6280a3a2094b992a056fb091f2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 22:01:28,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportWithTargetName/e4df8014675d4cb631774c9051bc866c 2023-10-01 22:01:28,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportWithTargetName/6eacfb6280a3a2094b992a056fb091f2 2023-10-01 22:01:28,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportWithTargetName/e4df8014675d4cb631774c9051bc866c 2023-10-01 22:01:28,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportWithTargetName/6eacfb6280a3a2094b992a056fb091f2 2023-10-01 22:01:28,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e4df8014675d4cb631774c9051bc866c 2023-10-01 22:01:28,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6eacfb6280a3a2094b992a056fb091f2 2023-10-01 22:01:28,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportWithTargetName/6eacfb6280a3a2094b992a056fb091f2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 22:01:28,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportWithTargetName/e4df8014675d4cb631774c9051bc866c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 22:01:28,964 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6eacfb6280a3a2094b992a056fb091f2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68665222, jitterRate=0.02319154143333435}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 22:01:28,964 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e4df8014675d4cb631774c9051bc866c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71237631, jitterRate=0.061523422598838806}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 22:01:28,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6eacfb6280a3a2094b992a056fb091f2: 2023-10-01 22:01:28,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e4df8014675d4cb631774c9051bc866c: 2023-10-01 22:01:28,966 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2., pid=16, masterSystemTime=1696197688918 2023-10-01 22:01:28,966 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c., pid=15, masterSystemTime=1696197688917 2023-10-01 22:01:28,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2. 2023-10-01 22:01:28,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2. 2023-10-01 22:01:28,970 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=6eacfb6280a3a2094b992a056fb091f2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:28,970 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696197688970"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696197688970"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696197688970"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696197688970"}]},"ts":"1696197688970"} 2023-10-01 22:01:28,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c. 2023-10-01 22:01:28,973 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c. 2023-10-01 22:01:28,973 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=e4df8014675d4cb631774c9051bc866c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:28,974 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696197688973"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696197688973"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696197688973"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696197688973"}]},"ts":"1696197688973"} 2023-10-01 22:01:28,979 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=13 2023-10-01 22:01:28,980 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 6eacfb6280a3a2094b992a056fb091f2, server=jenkins-hbase4.apache.org,42263,1696197680774 in 210 msec 2023-10-01 22:01:28,981 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-10-01 22:01:28,984 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure e4df8014675d4cb631774c9051bc866c, server=jenkins-hbase4.apache.org,37145,1696197680825 in 213 msec 2023-10-01 22:01:28,985 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=6eacfb6280a3a2094b992a056fb091f2, ASSIGN in 377 msec 2023-10-01 22:01:28,988 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=12 2023-10-01 22:01:28,988 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e4df8014675d4cb631774c9051bc866c, ASSIGN in 381 msec 2023-10-01 22:01:28,990 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 22:01:28,990 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696197688990"}]},"ts":"1696197688990"} 2023-10-01 22:01:28,992 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-10-01 22:01:28,996 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 22:01:29,003 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-10-01 22:01:29,012 DEBUG [hconnection-0x2a7e5561-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:01:29,014 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46672, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-10-01 22:01:29,023 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37145] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-01 22:01:29,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-01 22:01:29,054 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-01 22:01:29,054 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-01 22:01:29,054 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-01 22:01:29,054 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-01 22:01:29,054 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 22:01:29,063 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 22:01:29,063 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 22:01:29,063 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 22:01:29,063 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 22:01:29,065 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-01 22:01:29,065 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-01 22:01:29,065 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-01 22:01:29,065 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-01 22:01:29,067 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 650 msec 2023-10-01 22:01:29,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-01 22:01:29,540 INFO [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-10-01 22:01:29,544 DEBUG [Listener at jenkins-hbase4.apache.org/45715] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-01 22:01:29,545 DEBUG [Listener at jenkins-hbase4.apache.org/45715] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2. 2023-10-01 22:01:29,548 INFO [Listener at jenkins-hbase4.apache.org/45715] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 22:01:29,574 DEBUG [hconnection-0x719aedd4-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:01:29,577 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53588, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:01:29,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-01 22:01:29,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696197689591 (current time:1696197689591). 2023-10-01 22:01:29,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 22:01:29,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(139): Connect 0x513289e7 to 127.0.0.1:58905 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 22:01:29,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20e261ce, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 22:01:29,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:01:29,604 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46682, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:01:29,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x513289e7 to 127.0.0.1:58905 2023-10-01 22:01:29,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:01:29,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(139): Connect 0x22660818 to 127.0.0.1:58905 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 22:01:29,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7faf12bb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 22:01:29,615 DEBUG [hconnection-0x227a94f9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:01:29,616 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46684, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:01:29,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:01:29,622 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53592, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:01:29,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x22660818 to 127.0.0.1:58905 2023-10-01 22:01:29,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:01:29,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-01 22:01:29,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 22:01:29,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-01 22:01:29,659 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot, current working dir path: hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 22:01:29,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-01 22:01:29,681 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-01 22:01:29,682 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696198289682 2023-10-01 22:01:29,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-01 22:01:29,683 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-01 22:01:29,685 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-01 22:01:29,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-01 22:01:29,688 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 12 msec 2023-10-01 22:01:29,688 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-01 22:01:29,689 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696198289689 2023-10-01 22:01:29,690 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 22:01:29,690 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 22:01:29,709 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 22:01:29,710 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-10-01 22:01:29,711 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 22:01:29,711 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-10-01 22:01:29,711 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-01 22:01:29,711 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-10-01 22:01:29,711 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 22:01:29,711 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-10-01 22:01:29,712 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-01 22:01:29,712 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-10-01 22:01:29,720 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,720 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-10-01 22:01:29,720 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:01:29,721 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-10-01 22:01:29,721 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-01 22:01:29,722 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,722 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,727 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:01:29,727 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:01:29,727 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:29,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:01:29,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:01:29,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:01:29,727 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:01:29,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:01:29,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:01:29,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:01:29,728 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:29,728 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:29,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,729 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:29,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,729 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 22:01:29,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-01 22:01:29,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-01 22:01:29,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-01 22:01:29,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,731 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-01 22:01:29,731 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-01 22:01:29,731 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-01 22:01:29,734 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,734 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,734 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,737 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-01 22:01:29,737 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-01 22:01:29,737 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:01:29,737 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:01:29,738 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-01 22:01:29,737 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-01 22:01:29,739 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-01 22:01:29,739 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-01 22:01:29,739 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37145,1696197680825' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-01 22:01:29,739 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:01:29,739 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-01 22:01:29,740 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-01 22:01:29,740 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-01 22:01:29,740 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39235,1696197680862' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-01 22:01:29,740 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42263,1696197680774' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-01 22:01:29,743 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:29,743 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:29,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:01:29,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:01:29,744 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,744 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:01:29,744 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,744 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:29,745 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:01:29,745 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,745 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:01:29,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:01:29,745 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,745 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:01:29,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:29,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:29,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:29,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:01:29,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37145,1696197680825' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-01 22:01:29,748 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70942956[Count = 1] remaining members to acquire global barrier 2023-10-01 22:01:29,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:29,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:01:29,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:01:29,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:01:29,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:01:29,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:29,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:29,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:29,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:01:29,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42263,1696197680774' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-01 22:01:29,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70942956[Count = 0] remaining members to acquire global barrier 2023-10-01 22:01:29,751 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-01 22:01:29,751 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,753 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,753 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,753 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,753 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-01 22:01:29,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,754 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-01 22:01:29,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,754 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-01 22:01:29,754 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:29,754 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39235,1696197680862' in zk 2023-10-01 22:01:29,754 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-01 22:01:29,754 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:29,755 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 22:01:29,756 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 22:01:29,756 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2. 2023-10-01 22:01:29,756 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c. 2023-10-01 22:01:29,756 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 22:01:29,756 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 22:01:29,756 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 22:01:29,756 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2. started... 2023-10-01 22:01:29,756 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c. started... 2023-10-01 22:01:29,760 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6eacfb6280a3a2094b992a056fb091f2: 2023-10-01 22:01:29,760 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e4df8014675d4cb631774c9051bc866c: 2023-10-01 22:01:29,761 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-01 22:01:29,761 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:01:29,761 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-01 22:01:29,762 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,762 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,767 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 22:01:29,767 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 22:01:29,771 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 22:01:29,771 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 22:01:29,790 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 22:01:29,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-01 22:01:29,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-01 22:01:29,804 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 22:01:29,806 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c. completed. 2023-10-01 22:01:29,806 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c. 2023-10-01 22:01:29,807 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 22:01:29,807 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 22:01:29,807 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:29,807 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-01 22:01:29,807 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37145,1696197680825' in zk 2023-10-01 22:01:29,808 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2. completed. 2023-10-01 22:01:29,808 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2. 2023-10-01 22:01:29,809 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 22:01:29,809 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 22:01:29,809 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:29,809 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-01 22:01:29,809 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42263,1696197680774' in zk 2023-10-01 22:01:29,812 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:29,812 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-01 22:01:29,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:29,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:01:29,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:01:29,812 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:01:29,812 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-01 22:01:29,813 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:29,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:01:29,813 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-01 22:01:29,813 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:01:29,813 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-01 22:01:29,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:01:29,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:29,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:29,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:29,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:01:29,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:29,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:29,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:29,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,37145,1696197680825': 2023-10-01 22:01:29,819 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37145,1696197680825' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-01 22:01:29,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:29,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:01:29,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:01:29,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:01:29,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:01:29,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:29,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:29,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:29,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:01:29,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:29,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:29,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:29,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42263,1696197680774': 2023-10-01 22:01:29,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42263,1696197680774' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-01 22:01:29,824 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-10-01 22:01:29,824 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 22:01:29,824 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 22:01:29,824 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,824 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 22:01:29,827 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,827 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:01:29,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,827 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:01:29,827 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,827 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,827 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:01:29,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,828 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:29,827 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:01:29,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:01:29,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:01:29,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:01:29,828 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:29,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:01:29,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:01:29,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:01:29,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:01:29,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:01:29,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,829 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:29,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:01:29,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:29,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:29,831 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:29,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:29,832 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:29,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:01:29,832 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:29,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:29,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:29,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:29,846 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:29,846 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:01:29,846 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:01:29,846 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:01:29,846 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:01:29,846 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:29,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:01:29,846 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:01:29,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:01:29,846 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:01:29,846 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:01:29,847 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-01 22:01:29,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:01:29,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:01:29,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 22:01:29,846 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:01:29,846 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:29,846 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:01:29,848 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:01:29,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:01:29,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:01:29,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:01:29,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:01:29,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:01:29,848 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:29,849 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,849 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:29,849 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:29,849 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,849 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-01 22:01:29,865 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,928 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,929 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-01 22:01:29,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,930 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:29,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696197689683Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696197689865 (+182 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1696197689865Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1696197689865Writing data manifest for emptySnaptb0-testExportWithTargetName at 1696197689886 (+21 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1696197689917 (+31 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696197689929 (+12 ms) 2023-10-01 22:01:29,932 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-01 22:01:29,935 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 247 msec 2023-10-01 22:01:30,004 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 22:01:30,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-01 22:01:30,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 22:01:30,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42263] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 22:01:30,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37145] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 22:01:30,029 DEBUG [Listener at jenkins-hbase4.apache.org/45715] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-01 22:01:30,029 DEBUG [Listener at jenkins-hbase4.apache.org/45715] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2. 2023-10-01 22:01:30,029 INFO [Listener at jenkins-hbase4.apache.org/45715] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 22:01:30,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-01 22:01:30,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696197690045 (current time:1696197690045). 2023-10-01 22:01:30,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 22:01:30,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(139): Connect 0x77f5ae17 to 127.0.0.1:58905 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 22:01:30,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17704aa8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 22:01:30,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:01:30,058 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46694, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:01:30,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77f5ae17 to 127.0.0.1:58905 2023-10-01 22:01:30,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:01:30,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(139): Connect 0x7599b7be to 127.0.0.1:58905 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 22:01:30,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f463a0c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 22:01:30,067 DEBUG [hconnection-0x3a760046-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:01:30,069 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46708, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:01:30,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:01:30,075 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53608, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:01:30,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7599b7be to 127.0.0.1:58905 2023-10-01 22:01:30,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:01:30,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-01 22:01:30,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 22:01:30,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-01 22:01:30,080 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot, current working dir path: hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 22:01:30,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-01 22:01:30,083 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-01 22:01:30,084 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696198290084 2023-10-01 22:01:30,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-01 22:01:30,084 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-01 22:01:30,086 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 22:01:30,086 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 22:01:30,087 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-01 22:01:30,087 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-01 22:01:30,089 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-10-01 22:01:30,089 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-01 22:01:30,090 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696198290090 2023-10-01 22:01:30,108 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-10-01 22:01:30,108 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-10-01 22:01:30,108 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:01:30,109 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-10-01 22:01:30,109 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-01 22:01:30,109 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,109 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,112 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:01:30,112 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:01:30,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:01:30,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:01:30,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:01:30,112 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:30,112 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:01:30,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:01:30,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:01:30,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:01:30,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,113 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:30,113 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:30,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,114 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,114 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:30,114 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 22:01:30,114 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,114 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-01 22:01:30,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-01 22:01:30,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-01 22:01:30,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,114 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-01 22:01:30,115 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-01 22:01:30,115 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-01 22:01:30,115 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-01 22:01:30,115 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-01 22:01:30,115 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:01:30,115 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-01 22:01:30,116 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-01 22:01:30,116 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-01 22:01:30,115 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-01 22:01:30,116 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:01:30,116 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-01 22:01:30,117 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-01 22:01:30,117 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:01:30,116 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-01 22:01:30,117 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-01 22:01:30,117 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39235,1696197680862' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-01 22:01:30,117 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-01 22:01:30,117 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-01 22:01:30,118 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42263,1696197680774' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-01 22:01:30,117 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37145,1696197680825' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-01 22:01:30,120 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,121 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:30,121 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,121 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,121 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:01:30,121 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:30,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:30,121 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:01:30,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:01:30,121 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,121 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:01:30,121 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:01:30,121 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:01:30,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:01:30,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 22:01:30,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:30,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:30,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:30,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:01:30,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42263,1696197680774' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-01 22:01:30,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@672aabd1[Count = 1] remaining members to acquire global barrier 2023-10-01 22:01:30,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:30,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:01:30,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:01:30,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:01:30,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:01:30,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 22:01:30,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:30,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:30,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:30,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:01:30,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37145,1696197680825' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-01 22:01:30,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@672aabd1[Count = 0] remaining members to acquire global barrier 2023-10-01 22:01:30,126 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-01 22:01:30,126 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,131 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,131 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,131 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,131 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-01 22:01:30,131 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:30,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,132 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 22:01:30,132 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 22:01:30,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,132 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c. 2023-10-01 22:01:30,132 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-01 22:01:30,132 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c. started... 2023-10-01 22:01:30,132 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:30,132 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 22:01:30,132 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 22:01:30,132 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 22:01:30,132 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2. 2023-10-01 22:01:30,132 INFO [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e4df8014675d4cb631774c9051bc866c 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-10-01 22:01:30,132 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-01 22:01:30,132 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2. started... 2023-10-01 22:01:30,132 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-01 22:01:30,132 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39235,1696197680862' in zk 2023-10-01 22:01:30,132 INFO [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6eacfb6280a3a2094b992a056fb091f2 1/1 column families, dataSize=132 B heapSize=544 B 2023-10-01 22:01:30,134 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-01 22:01:30,135 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:01:30,135 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-01 22:01:30,186 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 22:01:30,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-01 22:01:30,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-01 22:01:30,188 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 22:01:30,274 INFO [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310017cbdb3b0aab74e9c8367542616e3b141 to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310017cbdb3b0aab74e9c8367542616e3b141 2023-10-01 22:01:30,274 INFO [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310018029c074bcb244c7961030bdb8cc8e29 to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310018029c074bcb244c7961030bdb8cc8e29 2023-10-01 22:01:30,307 INFO [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportWithTargetName/e4df8014675d4cb631774c9051bc866c/.tmp/cf/6b0b70f82cbb441aa0f68a8f590cd897 2023-10-01 22:01:30,309 INFO [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportWithTargetName/6eacfb6280a3a2094b992a056fb091f2/.tmp/cf/96191c6c1afb4bd49749f508c0499e29 2023-10-01 22:01:30,318 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportWithTargetName/e4df8014675d4cb631774c9051bc866c/.tmp/cf/6b0b70f82cbb441aa0f68a8f590cd897 as hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportWithTargetName/e4df8014675d4cb631774c9051bc866c/cf/6b0b70f82cbb441aa0f68a8f590cd897 2023-10-01 22:01:30,318 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportWithTargetName/6eacfb6280a3a2094b992a056fb091f2/.tmp/cf/96191c6c1afb4bd49749f508c0499e29 as hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportWithTargetName/6eacfb6280a3a2094b992a056fb091f2/cf/96191c6c1afb4bd49749f508c0499e29 2023-10-01 22:01:30,328 INFO [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportWithTargetName/6eacfb6280a3a2094b992a056fb091f2/cf/96191c6c1afb4bd49749f508c0499e29, entries=2, sequenceid=6, filesize=5.2 K 2023-10-01 22:01:30,328 INFO [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportWithTargetName/e4df8014675d4cb631774c9051bc866c/cf/6b0b70f82cbb441aa0f68a8f590cd897, entries=48, sequenceid=6, filesize=13.0 K 2023-10-01 22:01:30,333 INFO [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 6eacfb6280a3a2094b992a056fb091f2 in 201ms, sequenceid=6, compaction requested=false 2023-10-01 22:01:30,333 INFO [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for e4df8014675d4cb631774c9051bc866c in 201ms, sequenceid=6, compaction requested=false 2023-10-01 22:01:30,333 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-01 22:01:30,333 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-01 22:01:30,335 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e4df8014675d4cb631774c9051bc866c: 2023-10-01 22:01:30,335 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6eacfb6280a3a2094b992a056fb091f2: 2023-10-01 22:01:30,336 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-01 22:01:30,336 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-01 22:01:30,336 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 22:01:30,336 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 22:01:30,336 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportWithTargetName/6eacfb6280a3a2094b992a056fb091f2/cf/96191c6c1afb4bd49749f508c0499e29] hfiles 2023-10-01 22:01:30,336 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportWithTargetName/e4df8014675d4cb631774c9051bc866c/cf/6b0b70f82cbb441aa0f68a8f590cd897] hfiles 2023-10-01 22:01:30,336 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportWithTargetName/6eacfb6280a3a2094b992a056fb091f2/cf/96191c6c1afb4bd49749f508c0499e29 for snapshot=snaptb0-testExportWithTargetName 2023-10-01 22:01:30,336 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportWithTargetName/e4df8014675d4cb631774c9051bc866c/cf/6b0b70f82cbb441aa0f68a8f590cd897 for snapshot=snaptb0-testExportWithTargetName 2023-10-01 22:01:30,359 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2. completed. 2023-10-01 22:01:30,359 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2. 2023-10-01 22:01:30,359 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 22:01:30,360 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 22:01:30,360 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:30,360 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-01 22:01:30,360 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42263,1696197680774' in zk 2023-10-01 22:01:30,361 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c. completed. 2023-10-01 22:01:30,361 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c. 2023-10-01 22:01:30,361 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 22:01:30,361 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 22:01:30,361 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:30,361 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-01 22:01:30,361 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37145,1696197680825' in zk 2023-10-01 22:01:30,362 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:30,362 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-01 22:01:30,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:30,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:01:30,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:01:30,362 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:01:30,362 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-01 22:01:30,365 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:30,365 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-01 22:01:30,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:01:30,365 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:01:30,365 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-01 22:01:30,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:01:30,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 22:01:30,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:30,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:30,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:30,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:01:30,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 22:01:30,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:30,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:30,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:30,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42263,1696197680774': 2023-10-01 22:01:30,369 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42263,1696197680774' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-01 22:01:30,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:30,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:01:30,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:01:30,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:01:30,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:01:30,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 22:01:30,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:30,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:30,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:30,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:01:30,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 22:01:30,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:30,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:30,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:30,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,37145,1696197680825': 2023-10-01 22:01:30,373 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37145,1696197680825' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-01 22:01:30,373 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-10-01 22:01:30,373 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 22:01:30,373 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 22:01:30,373 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-10-01 22:01:30,373 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 22:01:30,375 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,375 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,375 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:01:30,375 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,375 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:01:30,375 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:01:30,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:01:30,376 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:01:30,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,376 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:30,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:01:30,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:01:30,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:01:30,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:01:30,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:01:30,377 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:30,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:01:30,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 22:01:30,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:01:30,377 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:30,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:01:30,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 22:01:30,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:30,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:30,379 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:30,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:30,380 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:30,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:01:30,380 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:30,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 22:01:30,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:30,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:30,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:30,390 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 22:01:30,391 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:30,391 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:01:30,391 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:01:30,391 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:01:30,391 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:01:30,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-01 22:01:30,391 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:01:30,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-01 22:01:30,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:01:30,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:01:30,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:01:30,391 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-10-01 22:01:30,391 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:01:30,391 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:30,391 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-01 22:01:30,391 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:01:30,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:01:30,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:01:30,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:01:30,391 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:01:30,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:01:30,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-01 22:01:30,393 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 22:01:30,392 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-01 22:01:30,391 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:30,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:01:30,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:01:30,393 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,393 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:30,393 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,393 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:30,393 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:30,393 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,393 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:01:30,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:01:30,394 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310018029c074bcb244c7961030bdb8cc8e29, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310017cbdb3b0aab74e9c8367542616e3b141] mob files 2023-10-01 22:01:30,394 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310018029c074bcb244c7961030bdb8cc8e29 2023-10-01 22:01:30,394 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310017cbdb3b0aab74e9c8367542616e3b141 2023-10-01 22:01:30,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-10-01 22:01:30,417 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,454 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,456 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-01 22:01:30,456 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,456 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-01 22:01:30,456 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696197690084Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696197690416 (+332 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1696197690416Loading Region manifests for snaptb0-testExportWithTargetName at 1696197690416Writing data manifest for snaptb0-testExportWithTargetName at 1696197690421 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1696197690443 (+22 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696197690456 (+13 ms) 2023-10-01 22:01:30,458 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-01 22:01:30,461 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 374 msec 2023-10-01 22:01:30,693 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 22:01:30,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-01 22:01:30,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 22:01:30,696 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197690696 2023-10-01 22:01:30,697 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36919, tgtDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197690696, rawTgtDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197690696, srcFsUri=hdfs://localhost:36919, srcDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9 2023-10-01 22:01:30,741 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36919, inputRoot=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9 2023-10-01 22:01:30,742 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_142359440_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197690696, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197690696/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-01 22:01:30,742 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36919, inputRoot=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9, snapshotDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-10-01 22:01:30,760 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197690696/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-01 22:01:31,216 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 22:01:31,217 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 22:01:31,218 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 22:01:31,218 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 22:01:32,153 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/hadoop-8908666045835233018.jar 2023-10-01 22:01:32,154 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 22:01:32,154 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 22:01:32,222 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/hadoop-8707731054947062880.jar 2023-10-01 22:01:32,222 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 22:01:32,223 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 22:01:32,224 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 22:01:32,224 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 22:01:32,225 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 22:01:32,226 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 22:01:32,226 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 22:01:32,227 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 22:01:32,228 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 22:01:32,228 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 22:01:32,229 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 22:01:32,230 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 22:01:32,231 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 22:01:32,231 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 22:01:32,232 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 22:01:32,233 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 22:01:32,238 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 22:01:32,238 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 22:01:32,239 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 22:01:32,240 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 22:01:32,240 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 22:01:32,241 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 22:01:32,241 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 22:01:33,085 WARN [Listener at jenkins-hbase4.apache.org/45715] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 22:01:33,091 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-10-01 22:01:33,099 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-01 22:01:33,561 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 22:01:33,563 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 22:01:34,200 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696197687246_0001_000001 (auth:SIMPLE) 2023-10-01 22:01:34,429 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 22:01:38,659 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696197687246_0001_000001 (auth:SIMPLE) 2023-10-01 22:01:40,910 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696197687246_0001_000001 (auth:SIMPLE) 2023-10-01 22:01:43,551 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696197687246_0001_000001 (auth:SIMPLE) 2023-10-01 22:01:44,967 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 22:01:44,970 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 22:01:44,985 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-10-01 22:01:44,985 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 22:01:44,986 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 22:01:44,986 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1693241814_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-01 22:01:44,987 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(367): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-10-01 22:01:44,987 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(367): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-10-01 22:01:44,987 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1693241814_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197690696/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197690696/.hbase-snapshot/testExportWithTargetName 2023-10-01 22:01:44,987 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(367): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197690696/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-10-01 22:01:44,987 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(367): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197690696/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-10-01 22:01:45,000 INFO [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-10-01 22:01:45,006 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-10-01 22:01:45,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-10-01 22:01:45,019 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696197705019"}]},"ts":"1696197705019"} 2023-10-01 22:01:45,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-01 22:01:45,021 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-10-01 22:01:45,023 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-10-01 22:01:45,025 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=6eacfb6280a3a2094b992a056fb091f2, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e4df8014675d4cb631774c9051bc866c, UNASSIGN}] 2023-10-01 22:01:45,028 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=6eacfb6280a3a2094b992a056fb091f2, UNASSIGN 2023-10-01 22:01:45,028 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e4df8014675d4cb631774c9051bc866c, UNASSIGN 2023-10-01 22:01:45,029 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=6eacfb6280a3a2094b992a056fb091f2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:45,029 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=e4df8014675d4cb631774c9051bc866c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:45,029 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696197705029"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696197705029"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696197705029"}]},"ts":"1696197705029"} 2023-10-01 22:01:45,030 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696197705029"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696197705029"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696197705029"}]},"ts":"1696197705029"} 2023-10-01 22:01:45,031 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 6eacfb6280a3a2094b992a056fb091f2, server=jenkins-hbase4.apache.org,42263,1696197680774}] 2023-10-01 22:01:45,032 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure e4df8014675d4cb631774c9051bc866c, server=jenkins-hbase4.apache.org,37145,1696197680825}] 2023-10-01 22:01:45,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-01 22:01:45,193 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e4df8014675d4cb631774c9051bc866c 2023-10-01 22:01:45,193 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6eacfb6280a3a2094b992a056fb091f2 2023-10-01 22:01:45,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e4df8014675d4cb631774c9051bc866c, disabling compactions & flushes 2023-10-01 22:01:45,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6eacfb6280a3a2094b992a056fb091f2, disabling compactions & flushes 2023-10-01 22:01:45,193 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c. 2023-10-01 22:01:45,193 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2. 2023-10-01 22:01:45,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c. 2023-10-01 22:01:45,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2. 2023-10-01 22:01:45,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c. after waiting 0 ms 2023-10-01 22:01:45,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c. 2023-10-01 22:01:45,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2. after waiting 0 ms 2023-10-01 22:01:45,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2. 2023-10-01 22:01:45,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportWithTargetName/e4df8014675d4cb631774c9051bc866c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 22:01:45,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportWithTargetName/6eacfb6280a3a2094b992a056fb091f2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 22:01:45,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 22:01:45,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 22:01:45,209 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c. 2023-10-01 22:01:45,209 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2. 2023-10-01 22:01:45,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e4df8014675d4cb631774c9051bc866c: 2023-10-01 22:01:45,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6eacfb6280a3a2094b992a056fb091f2: 2023-10-01 22:01:45,212 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6eacfb6280a3a2094b992a056fb091f2 2023-10-01 22:01:45,213 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=6eacfb6280a3a2094b992a056fb091f2, regionState=CLOSED 2023-10-01 22:01:45,213 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e4df8014675d4cb631774c9051bc866c 2023-10-01 22:01:45,213 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696197705212"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696197705212"}]},"ts":"1696197705212"} 2023-10-01 22:01:45,214 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=e4df8014675d4cb631774c9051bc866c, regionState=CLOSED 2023-10-01 22:01:45,214 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696197705213"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696197705213"}]},"ts":"1696197705213"} 2023-10-01 22:01:45,217 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-10-01 22:01:45,217 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 6eacfb6280a3a2094b992a056fb091f2, server=jenkins-hbase4.apache.org,42263,1696197680774 in 183 msec 2023-10-01 22:01:45,218 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-10-01 22:01:45,218 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure e4df8014675d4cb631774c9051bc866c, server=jenkins-hbase4.apache.org,37145,1696197680825 in 184 msec 2023-10-01 22:01:45,219 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=6eacfb6280a3a2094b992a056fb091f2, UNASSIGN in 192 msec 2023-10-01 22:01:45,221 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=23, resume processing ppid=21 2023-10-01 22:01:45,221 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e4df8014675d4cb631774c9051bc866c, UNASSIGN in 193 msec 2023-10-01 22:01:45,222 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696197705222"}]},"ts":"1696197705222"} 2023-10-01 22:01:45,223 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-10-01 22:01:45,225 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-10-01 22:01:45,228 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 217 msec 2023-10-01 22:01:45,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-01 22:01:45,323 INFO [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-10-01 22:01:45,328 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-10-01 22:01:45,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-01 22:01:45,340 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-01 22:01:45,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-10-01 22:01:45,342 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-01 22:01:45,346 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37145] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-10-01 22:01:45,348 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportWithTargetName/6eacfb6280a3a2094b992a056fb091f2 2023-10-01 22:01:45,348 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportWithTargetName/e4df8014675d4cb631774c9051bc866c 2023-10-01 22:01:45,351 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportWithTargetName/6eacfb6280a3a2094b992a056fb091f2/cf, FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportWithTargetName/6eacfb6280a3a2094b992a056fb091f2/recovered.edits] 2023-10-01 22:01:45,351 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportWithTargetName/e4df8014675d4cb631774c9051bc866c/cf, FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportWithTargetName/e4df8014675d4cb631774c9051bc866c/recovered.edits] 2023-10-01 22:01:45,355 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 22:01:45,355 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 22:01:45,355 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 22:01:45,355 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 22:01:45,355 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-01 22:01:45,355 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-01 22:01:45,356 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-01 22:01:45,356 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-01 22:01:45,356 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 22:01:45,356 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:01:45,356 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 22:01:45,356 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 22:01:45,357 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:01:45,357 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:01:45,357 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 22:01:45,358 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:01:45,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-01 22:01:45,361 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportWithTargetName/e4df8014675d4cb631774c9051bc866c/cf/6b0b70f82cbb441aa0f68a8f590cd897 to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testExportWithTargetName/e4df8014675d4cb631774c9051bc866c/cf/6b0b70f82cbb441aa0f68a8f590cd897 2023-10-01 22:01:45,361 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportWithTargetName/6eacfb6280a3a2094b992a056fb091f2/cf/96191c6c1afb4bd49749f508c0499e29 to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testExportWithTargetName/6eacfb6280a3a2094b992a056fb091f2/cf/96191c6c1afb4bd49749f508c0499e29 2023-10-01 22:01:45,365 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportWithTargetName/e4df8014675d4cb631774c9051bc866c/recovered.edits/9.seqid to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testExportWithTargetName/e4df8014675d4cb631774c9051bc866c/recovered.edits/9.seqid 2023-10-01 22:01:45,365 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportWithTargetName/6eacfb6280a3a2094b992a056fb091f2/recovered.edits/9.seqid to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testExportWithTargetName/6eacfb6280a3a2094b992a056fb091f2/recovered.edits/9.seqid 2023-10-01 22:01:45,366 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportWithTargetName/e4df8014675d4cb631774c9051bc866c 2023-10-01 22:01:45,366 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportWithTargetName/6eacfb6280a3a2094b992a056fb091f2 2023-10-01 22:01:45,366 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-01 22:01:45,367 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-01 22:01:45,368 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-10-01 22:01:45,372 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310018029c074bcb244c7961030bdb8cc8e29 to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310018029c074bcb244c7961030bdb8cc8e29 2023-10-01 22:01:45,373 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310017cbdb3b0aab74e9c8367542616e3b141 to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310017cbdb3b0aab74e9c8367542616e3b141 2023-10-01 22:01:45,374 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-01 22:01:45,377 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-01 22:01:45,397 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-10-01 22:01:45,400 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-10-01 22:01:45,402 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-01 22:01:45,402 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-10-01 22:01:45,402 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696197705402"}]},"ts":"9223372036854775807"} 2023-10-01 22:01:45,402 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696197705402"}]},"ts":"9223372036854775807"} 2023-10-01 22:01:45,404 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-01 22:01:45,404 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6eacfb6280a3a2094b992a056fb091f2, NAME => 'testtb-testExportWithTargetName,,1696197688413.6eacfb6280a3a2094b992a056fb091f2.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e4df8014675d4cb631774c9051bc866c, NAME => 'testtb-testExportWithTargetName,1,1696197688413.e4df8014675d4cb631774c9051bc866c.', STARTKEY => '1', ENDKEY => ''}] 2023-10-01 22:01:45,404 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-10-01 22:01:45,405 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696197705404"}]},"ts":"9223372036854775807"} 2023-10-01 22:01:45,406 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-10-01 22:01:45,409 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-01 22:01:45,410 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 80 msec 2023-10-01 22:01:45,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-01 22:01:45,464 INFO [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-10-01 22:01:45,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-10-01 22:01:45,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-10-01 22:01:45,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-10-01 22:01:45,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportWithTargetName 2023-10-01 22:01:45,525 INFO [Listener at jenkins-hbase4.apache.org/45715] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=752 (was 705) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/cluster_acb7ca10-02c8-106a-9d3a-fe6c12cc0094/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6cc451db-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1525120177_1 at /127.0.0.1:38584 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1693241814_17 at /127.0.0.1:38610 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6cc451db-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/cluster_acb7ca10-02c8-106a-9d3a-fe6c12cc0094/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/cluster_acb7ca10-02c8-106a-9d3a-fe6c12cc0094/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/cluster_acb7ca10-02c8-106a-9d3a-fe6c12cc0094/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/cluster_acb7ca10-02c8-106a-9d3a-fe6c12cc0094/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:41385 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1282 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6cc451db-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6cc451db-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1525120177_1 at /127.0.0.1:49684 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:38013 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1693241814_17 at /127.0.0.1:49708 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/cluster_acb7ca10-02c8-106a-9d3a-fe6c12cc0094/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:37673 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1693241814_17 at /127.0.0.1:53140 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=923 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=191 (was 148) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=1611 (was 2409) 2023-10-01 22:01:45,526 WARN [Listener at jenkins-hbase4.apache.org/45715] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-10-01 22:01:45,544 INFO [Listener at jenkins-hbase4.apache.org/45715] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=752, OpenFileDescriptor=923, MaxFileDescriptor=60000, SystemLoadAverage=191, ProcessCount=168, AvailableMemoryMB=1610 2023-10-01 22:01:45,544 WARN [Listener at jenkins-hbase4.apache.org/45715] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-10-01 22:01:45,546 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-01 22:01:45,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-10-01 22:01:45,550 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 22:01:45,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-10-01 22:01:45,552 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 22:01:45,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-01 22:01:45,555 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemState/c406354d6acaadb58ac540b0c2352025 2023-10-01 22:01:45,555 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemState/ddb81fdef42088904cb030e83b5255cd 2023-10-01 22:01:45,556 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemState/c406354d6acaadb58ac540b0c2352025 empty. 2023-10-01 22:01:45,556 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemState/ddb81fdef42088904cb030e83b5255cd empty. 2023-10-01 22:01:45,556 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemState/c406354d6acaadb58ac540b0c2352025 2023-10-01 22:01:45,556 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemState/ddb81fdef42088904cb030e83b5255cd 2023-10-01 22:01:45,556 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-01 22:01:45,572 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-01 22:01:45,574 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => c406354d6acaadb58ac540b0c2352025, NAME => 'testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp 2023-10-01 22:01:45,574 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => ddb81fdef42088904cb030e83b5255cd, NAME => 'testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp 2023-10-01 22:01:45,599 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:01:45,599 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing ddb81fdef42088904cb030e83b5255cd, disabling compactions & flushes 2023-10-01 22:01:45,599 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd. 2023-10-01 22:01:45,599 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd. 2023-10-01 22:01:45,599 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd. after waiting 0 ms 2023-10-01 22:01:45,599 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd. 2023-10-01 22:01:45,599 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd. 2023-10-01 22:01:45,599 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for ddb81fdef42088904cb030e83b5255cd: 2023-10-01 22:01:45,601 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:01:45,602 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing c406354d6acaadb58ac540b0c2352025, disabling compactions & flushes 2023-10-01 22:01:45,602 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025. 2023-10-01 22:01:45,602 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025. 2023-10-01 22:01:45,602 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025. after waiting 0 ms 2023-10-01 22:01:45,602 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025. 2023-10-01 22:01:45,602 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025. 2023-10-01 22:01:45,602 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for c406354d6acaadb58ac540b0c2352025: 2023-10-01 22:01:45,605 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 22:01:45,606 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696197705606"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696197705606"}]},"ts":"1696197705606"} 2023-10-01 22:01:45,606 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696197705606"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696197705606"}]},"ts":"1696197705606"} 2023-10-01 22:01:45,609 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 22:01:45,610 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 22:01:45,610 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696197705610"}]},"ts":"1696197705610"} 2023-10-01 22:01:45,612 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-10-01 22:01:45,616 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 22:01:45,618 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 22:01:45,618 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 22:01:45,618 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 22:01:45,618 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 22:01:45,618 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c406354d6acaadb58ac540b0c2352025, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ddb81fdef42088904cb030e83b5255cd, ASSIGN}] 2023-10-01 22:01:45,621 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c406354d6acaadb58ac540b0c2352025, ASSIGN 2023-10-01 22:01:45,621 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ddb81fdef42088904cb030e83b5255cd, ASSIGN 2023-10-01 22:01:45,622 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c406354d6acaadb58ac540b0c2352025, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42263,1696197680774; forceNewPlan=false, retain=false 2023-10-01 22:01:45,622 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ddb81fdef42088904cb030e83b5255cd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39235,1696197680862; forceNewPlan=false, retain=false 2023-10-01 22:01:45,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-01 22:01:45,772 INFO [jenkins-hbase4:40311] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 22:01:45,775 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=c406354d6acaadb58ac540b0c2352025, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:45,775 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=ddb81fdef42088904cb030e83b5255cd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:45,775 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696197705775"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696197705775"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696197705775"}]},"ts":"1696197705775"} 2023-10-01 22:01:45,775 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696197705775"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696197705775"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696197705775"}]},"ts":"1696197705775"} 2023-10-01 22:01:45,778 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure c406354d6acaadb58ac540b0c2352025, server=jenkins-hbase4.apache.org,42263,1696197680774}] 2023-10-01 22:01:45,779 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure ddb81fdef42088904cb030e83b5255cd, server=jenkins-hbase4.apache.org,39235,1696197680862}] 2023-10-01 22:01:45,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-01 22:01:45,934 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:45,934 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-01 22:01:45,938 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38556, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-01 22:01:45,939 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025. 2023-10-01 22:01:45,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c406354d6acaadb58ac540b0c2352025, NAME => 'testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025.', STARTKEY => '', ENDKEY => '1'} 2023-10-01 22:01:45,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025. service=AccessControlService 2023-10-01 22:01:45,942 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 22:01:45,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState c406354d6acaadb58ac540b0c2352025 2023-10-01 22:01:45,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:01:45,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c406354d6acaadb58ac540b0c2352025 2023-10-01 22:01:45,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c406354d6acaadb58ac540b0c2352025 2023-10-01 22:01:45,945 INFO [StoreOpener-c406354d6acaadb58ac540b0c2352025-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c406354d6acaadb58ac540b0c2352025 2023-10-01 22:01:45,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd. 2023-10-01 22:01:45,946 DEBUG [StoreOpener-c406354d6acaadb58ac540b0c2352025-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemState/c406354d6acaadb58ac540b0c2352025/cf 2023-10-01 22:01:45,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ddb81fdef42088904cb030e83b5255cd, NAME => 'testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd.', STARTKEY => '1', ENDKEY => ''} 2023-10-01 22:01:45,946 DEBUG [StoreOpener-c406354d6acaadb58ac540b0c2352025-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemState/c406354d6acaadb58ac540b0c2352025/cf 2023-10-01 22:01:45,947 INFO [StoreOpener-c406354d6acaadb58ac540b0c2352025-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c406354d6acaadb58ac540b0c2352025 columnFamilyName cf 2023-10-01 22:01:45,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd. service=AccessControlService 2023-10-01 22:01:45,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 22:01:45,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState ddb81fdef42088904cb030e83b5255cd 2023-10-01 22:01:45,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:01:45,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ddb81fdef42088904cb030e83b5255cd 2023-10-01 22:01:45,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ddb81fdef42088904cb030e83b5255cd 2023-10-01 22:01:45,949 INFO [StoreOpener-c406354d6acaadb58ac540b0c2352025-1] regionserver.HStore(310): Store=c406354d6acaadb58ac540b0c2352025/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 22:01:45,950 INFO [StoreOpener-ddb81fdef42088904cb030e83b5255cd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ddb81fdef42088904cb030e83b5255cd 2023-10-01 22:01:45,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemState/c406354d6acaadb58ac540b0c2352025 2023-10-01 22:01:45,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemState/c406354d6acaadb58ac540b0c2352025 2023-10-01 22:01:45,951 DEBUG [StoreOpener-ddb81fdef42088904cb030e83b5255cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemState/ddb81fdef42088904cb030e83b5255cd/cf 2023-10-01 22:01:45,951 DEBUG [StoreOpener-ddb81fdef42088904cb030e83b5255cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemState/ddb81fdef42088904cb030e83b5255cd/cf 2023-10-01 22:01:45,952 INFO [StoreOpener-ddb81fdef42088904cb030e83b5255cd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ddb81fdef42088904cb030e83b5255cd columnFamilyName cf 2023-10-01 22:01:45,953 INFO [StoreOpener-ddb81fdef42088904cb030e83b5255cd-1] regionserver.HStore(310): Store=ddb81fdef42088904cb030e83b5255cd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 22:01:45,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemState/ddb81fdef42088904cb030e83b5255cd 2023-10-01 22:01:45,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemState/ddb81fdef42088904cb030e83b5255cd 2023-10-01 22:01:45,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c406354d6acaadb58ac540b0c2352025 2023-10-01 22:01:45,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemState/c406354d6acaadb58ac540b0c2352025/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 22:01:45,958 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c406354d6acaadb58ac540b0c2352025; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71683158, jitterRate=0.06816229224205017}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 22:01:45,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c406354d6acaadb58ac540b0c2352025: 2023-10-01 22:01:45,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ddb81fdef42088904cb030e83b5255cd 2023-10-01 22:01:45,959 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025., pid=30, masterSystemTime=1696197705931 2023-10-01 22:01:45,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025. 2023-10-01 22:01:45,961 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025. 2023-10-01 22:01:45,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemState/ddb81fdef42088904cb030e83b5255cd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 22:01:45,962 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ddb81fdef42088904cb030e83b5255cd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73095483, jitterRate=0.08920757472515106}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 22:01:45,962 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=c406354d6acaadb58ac540b0c2352025, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:45,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ddb81fdef42088904cb030e83b5255cd: 2023-10-01 22:01:45,962 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696197705962"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696197705962"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696197705962"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696197705962"}]},"ts":"1696197705962"} 2023-10-01 22:01:45,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd., pid=31, masterSystemTime=1696197705934 2023-10-01 22:01:45,968 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=ddb81fdef42088904cb030e83b5255cd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:45,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd. 2023-10-01 22:01:45,969 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696197705968"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696197705968"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696197705968"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696197705968"}]},"ts":"1696197705968"} 2023-10-01 22:01:45,970 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd. 2023-10-01 22:01:45,972 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=28 2023-10-01 22:01:45,973 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure c406354d6acaadb58ac540b0c2352025, server=jenkins-hbase4.apache.org,42263,1696197680774 in 189 msec 2023-10-01 22:01:45,975 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c406354d6acaadb58ac540b0c2352025, ASSIGN in 355 msec 2023-10-01 22:01:45,975 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-10-01 22:01:45,975 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure ddb81fdef42088904cb030e83b5255cd, server=jenkins-hbase4.apache.org,39235,1696197680862 in 193 msec 2023-10-01 22:01:45,978 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-10-01 22:01:45,978 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ddb81fdef42088904cb030e83b5255cd, ASSIGN in 358 msec 2023-10-01 22:01:45,979 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 22:01:45,979 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696197705979"}]},"ts":"1696197705979"} 2023-10-01 22:01:45,981 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-10-01 22:01:45,984 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 22:01:45,984 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-10-01 22:01:45,987 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37145] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-01 22:01:45,988 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:01:45,988 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:01:45,988 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:01:45,988 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:01:45,990 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 22:01:45,990 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 22:01:45,990 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 22:01:45,990 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 22:01:45,993 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 444 msec 2023-10-01 22:01:46,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-01 22:01:46,157 INFO [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-10-01 22:01:46,160 DEBUG [Listener at jenkins-hbase4.apache.org/45715] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-01 22:01:46,160 DEBUG [Listener at jenkins-hbase4.apache.org/45715] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025. 2023-10-01 22:01:46,162 INFO [Listener at jenkins-hbase4.apache.org/45715] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 22:01:46,172 DEBUG [hconnection-0x719aedd4-shared-pool-11] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:01:46,178 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38572, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:01:46,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 22:01:46,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696197706182 (current time:1696197706182). 2023-10-01 22:01:46,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 22:01:46,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(139): Connect 0x616b3db4 to 127.0.0.1:58905 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 22:01:46,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f5fcc45, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 22:01:46,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:01:46,193 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46312, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:01:46,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x616b3db4 to 127.0.0.1:58905 2023-10-01 22:01:46,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:01:46,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(139): Connect 0x38ddc539 to 127.0.0.1:58905 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 22:01:46,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63d90b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 22:01:46,203 DEBUG [hconnection-0x217f00a6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:01:46,205 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46328, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:01:46,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:01:46,210 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37980, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:01:46,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x38ddc539 to 127.0.0.1:58905 2023-10-01 22:01:46,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:01:46,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-01 22:01:46,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 22:01:46,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 22:01:46,215 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot, current working dir path: hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 22:01:46,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-01 22:01:46,218 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-01 22:01:46,219 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696198306219 2023-10-01 22:01:46,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 22:01:46,219 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-01 22:01:46,220 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 22:01:46,220 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 22:01:46,221 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-01 22:01:46,221 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-01 22:01:46,223 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-10-01 22:01:46,224 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-01 22:01:46,224 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696198306224 2023-10-01 22:01:46,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,239 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-10-01 22:01:46,239 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:01:46,240 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-10-01 22:01:46,240 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-01 22:01:46,240 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,240 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,242 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:01:46,243 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:01:46,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:01:46,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:01:46,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:01:46,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:01:46,243 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:46,243 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:01:46,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:01:46,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:01:46,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,243 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:46,243 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:46,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,244 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,244 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,244 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,244 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:46,244 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 22:01:46,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-01 22:01:46,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-01 22:01:46,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-01 22:01:46,244 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-01 22:01:46,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,244 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-01 22:01:46,244 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-01 22:01:46,244 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,244 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,245 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-01 22:01:46,245 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-01 22:01:46,245 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:01:46,245 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,245 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:01:46,246 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-01 22:01:46,246 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-01 22:01:46,246 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-01 22:01:46,246 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:01:46,245 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-01 22:01:46,247 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-01 22:01:46,247 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-01 22:01:46,246 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42263,1696197680774' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-01 22:01:46,247 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37145,1696197680825' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-01 22:01:46,247 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-01 22:01:46,247 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39235,1696197680862' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-01 22:01:46,249 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,254 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:46,254 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:46,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:01:46,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:01:46,254 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:46,254 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,254 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,254 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:01:46,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:01:46,255 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,255 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:01:46,255 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,255 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:01:46,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:01:46,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:46,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:46,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:46,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:01:46,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42263,1696197680774' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-01 22:01:46,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72515dac[Count = 1] remaining members to acquire global barrier 2023-10-01 22:01:46,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:46,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:01:46,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:01:46,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:01:46,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:01:46,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:46,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:46,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:46,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:01:46,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39235,1696197680862' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-01 22:01:46,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72515dac[Count = 0] remaining members to acquire global barrier 2023-10-01 22:01:46,259 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-01 22:01:46,259 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,261 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,261 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,261 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,261 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-01 22:01:46,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,262 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:46,262 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-01 22:01:46,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,262 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37145,1696197680825' in zk 2023-10-01 22:01:46,262 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-01 22:01:46,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,262 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:46,262 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-01 22:01:46,262 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 22:01:46,262 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 22:01:46,262 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 22:01:46,262 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd. 2023-10-01 22:01:46,263 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 22:01:46,263 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd. started... 2023-10-01 22:01:46,263 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 22:01:46,263 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025. 2023-10-01 22:01:46,263 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025. started... 2023-10-01 22:01:46,264 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ddb81fdef42088904cb030e83b5255cd: 2023-10-01 22:01:46,264 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c406354d6acaadb58ac540b0c2352025: 2023-10-01 22:01:46,264 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,264 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-01 22:01:46,264 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 22:01:46,264 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:01:46,265 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 22:01:46,265 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,265 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-01 22:01:46,266 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 22:01:46,266 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 22:01:46,281 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd. completed. 2023-10-01 22:01:46,281 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd. 2023-10-01 22:01:46,281 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 22:01:46,281 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 22:01:46,281 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:46,281 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-01 22:01:46,281 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39235,1696197680862' in zk 2023-10-01 22:01:46,282 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025. completed. 2023-10-01 22:01:46,282 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025. 2023-10-01 22:01:46,282 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 22:01:46,282 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 22:01:46,282 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:46,282 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-01 22:01:46,282 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42263,1696197680774' in zk 2023-10-01 22:01:46,283 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-01 22:01:46,283 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:01:46,283 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:46,283 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-01 22:01:46,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:46,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:01:46,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:01:46,286 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:46,286 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-01 22:01:46,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:01:46,286 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:01:46,286 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-01 22:01:46,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:01:46,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:46,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:46,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:46,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:01:46,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:46,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:46,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:46,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39235,1696197680862': 2023-10-01 22:01:46,291 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39235,1696197680862' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-01 22:01:46,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:46,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:01:46,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:01:46,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:01:46,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:01:46,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:46,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:46,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:46,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:01:46,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:46,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:46,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:46,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42263,1696197680774': 2023-10-01 22:01:46,295 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42263,1696197680774' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-01 22:01:46,295 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-10-01 22:01:46,295 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 22:01:46,295 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 22:01:46,295 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,295 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 22:01:46,298 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,298 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,298 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,298 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,298 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:01:46,298 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:01:46,298 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:46,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:01:46,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:01:46,298 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:01:46,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:01:46,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:01:46,299 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:46,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:01:46,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:01:46,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:01:46,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:01:46,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:01:46,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,299 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:46,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:01:46,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:46,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:46,301 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:46,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:46,301 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:46,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:01:46,302 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:46,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:46,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:46,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:46,305 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:46,305 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:01:46,305 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:01:46,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:01:46,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:01:46,305 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:01:46,305 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,305 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:01:46,305 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:01:46,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:01:46,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:01:46,305 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:01:46,305 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,305 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:46,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:01:46,307 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:46,305 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:01:46,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:01:46,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:01:46,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:01:46,307 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:01:46,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:01:46,307 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-01 22:01:46,307 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:46,307 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,307 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:46,307 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,307 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:46,307 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 22:01:46,307 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,307 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:01:46,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:01:46,308 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-01 22:01:46,318 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,319 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,320 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 22:01:46,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 22:01:46,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-01 22:01:46,322 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 22:01:46,349 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,350 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-01 22:01:46,350 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,350 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-01 22:01:46,350 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696197706219Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696197706318 (+99 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1696197706318Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1696197706318Writing data manifest for emptySnaptb0-testExportFileSystemState at 1696197706322 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1696197706342 (+20 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696197706350 (+8 ms) 2023-10-01 22:01:46,352 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-01 22:01:46,354 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 132 msec 2023-10-01 22:01:46,522 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 22:01:46,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 22:01:46,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 22:01:46,528 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42263] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 22:01:46,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39235] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 22:01:46,534 DEBUG [Listener at jenkins-hbase4.apache.org/45715] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-01 22:01:46,534 DEBUG [Listener at jenkins-hbase4.apache.org/45715] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025. 2023-10-01 22:01:46,534 INFO [Listener at jenkins-hbase4.apache.org/45715] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 22:01:46,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 22:01:46,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696197706547 (current time:1696197706547). 2023-10-01 22:01:46,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 22:01:46,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(139): Connect 0x6e44b06d to 127.0.0.1:58905 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 22:01:46,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c2b6a41, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 22:01:46,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:01:46,558 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-10-01 22:01:46,558 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46334, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:01:46,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e44b06d to 127.0.0.1:58905 2023-10-01 22:01:46,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:01:46,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(139): Connect 0x0528b78a to 127.0.0.1:58905 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 22:01:46,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39aaaa7d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 22:01:46,568 DEBUG [hconnection-0x5510bad3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:01:46,568 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46338, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:01:46,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:01:46,575 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37992, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:01:46,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0528b78a to 127.0.0.1:58905 2023-10-01 22:01:46,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:01:46,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-01 22:01:46,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 22:01:46,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 22:01:46,579 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot, current working dir path: hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 22:01:46,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-01 22:01:46,582 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-01 22:01:46,582 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696198306582 2023-10-01 22:01:46,583 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-01 22:01:46,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 22:01:46,584 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 22:01:46,584 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 22:01:46,584 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-01 22:01:46,585 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-01 22:01:46,587 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-10-01 22:01:46,588 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-01 22:01:46,588 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696198306588 2023-10-01 22:01:46,602 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-10-01 22:01:46,602 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-10-01 22:01:46,602 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:01:46,604 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-10-01 22:01:46,604 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-01 22:01:46,604 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 22:01:46,604 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 22:01:46,605 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:01:46,605 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:46,606 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:01:46,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:01:46,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:01:46,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:01:46,606 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:01:46,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:01:46,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:01:46,606 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:46,606 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:46,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:01:46,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 22:01:46,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 22:01:46,606 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:46,606 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 22:01:46,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 22:01:46,607 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 22:01:46,607 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 22:01:46,607 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 22:01:46,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-01 22:01:46,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 22:01:46,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-01 22:01:46,607 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-01 22:01:46,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-01 22:01:46,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 22:01:46,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 22:01:46,607 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-01 22:01:46,607 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-01 22:01:46,608 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-01 22:01:46,608 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:01:46,608 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-01 22:01:46,614 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-01 22:01:46,608 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-01 22:01:46,614 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-01 22:01:46,614 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-01 22:01:46,614 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42263,1696197680774' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-01 22:01:46,614 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:01:46,614 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-01 22:01:46,615 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-01 22:01:46,615 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-01 22:01:46,615 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39235,1696197680862' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-01 22:01:46,615 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-01 22:01:46,615 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:01:46,616 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-01 22:01:46,616 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-01 22:01:46,616 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37145,1696197680825' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-01 22:01:46,618 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 22:01:46,618 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:46,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:46,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:01:46,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:01:46,619 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 22:01:46,619 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:01:46,619 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:46,619 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 22:01:46,619 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 22:01:46,619 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 22:01:46,619 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:01:46,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:01:46,620 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 22:01:46,620 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:01:46,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:01:46,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 22:01:46,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:46,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:46,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:46,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:01:46,621 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42263,1696197680774' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-01 22:01:46,621 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23de1429[Count = 1] remaining members to acquire global barrier 2023-10-01 22:01:46,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:46,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:01:46,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:01:46,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:01:46,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:01:46,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 22:01:46,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:46,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:46,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:46,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:01:46,623 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39235,1696197680862' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-01 22:01:46,623 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23de1429[Count = 0] remaining members to acquire global barrier 2023-10-01 22:01:46,623 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-01 22:01:46,623 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 22:01:46,624 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 22:01:46,624 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 22:01:46,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 22:01:46,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 22:01:46,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 22:01:46,624 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 22:01:46,625 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-01 22:01:46,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 22:01:46,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 22:01:46,625 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:46,625 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-01 22:01:46,625 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-01 22:01:46,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 22:01:46,625 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 22:01:46,625 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 22:01:46,625 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025. 2023-10-01 22:01:46,625 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37145,1696197680825' in zk 2023-10-01 22:01:46,625 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025. started... 2023-10-01 22:01:46,625 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-01 22:01:46,626 INFO [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c406354d6acaadb58ac540b0c2352025 1/1 column families, dataSize=333 B heapSize=976 B 2023-10-01 22:01:46,625 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:46,626 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 22:01:46,626 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 22:01:46,626 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 22:01:46,626 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd. 2023-10-01 22:01:46,626 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd. started... 2023-10-01 22:01:46,626 INFO [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ddb81fdef42088904cb030e83b5255cd 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-10-01 22:01:46,628 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-01 22:01:46,628 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:01:46,628 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-01 22:01:46,652 INFO [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231001aa00691f61204da18d9820ad83375aca to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231001aa00691f61204da18d9820ad83375aca 2023-10-01 22:01:46,652 INFO [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310019de7c75ec1794c57abcaf69d0597c1ce to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310019de7c75ec1794c57abcaf69d0597c1ce 2023-10-01 22:01:46,684 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 22:01:46,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 22:01:46,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-01 22:01:46,688 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 22:01:46,889 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 22:01:46,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 22:01:46,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-01 22:01:46,890 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-01 22:01:47,067 INFO [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemState/c406354d6acaadb58ac540b0c2352025/.tmp/cf/d45c3537d23e40df91bb44cfaaff6434 2023-10-01 22:01:47,067 INFO [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemState/ddb81fdef42088904cb030e83b5255cd/.tmp/cf/841c5935b7e549efb968d48455b16785 2023-10-01 22:01:47,075 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemState/ddb81fdef42088904cb030e83b5255cd/.tmp/cf/841c5935b7e549efb968d48455b16785 as hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemState/ddb81fdef42088904cb030e83b5255cd/cf/841c5935b7e549efb968d48455b16785 2023-10-01 22:01:47,075 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemState/c406354d6acaadb58ac540b0c2352025/.tmp/cf/d45c3537d23e40df91bb44cfaaff6434 as hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemState/c406354d6acaadb58ac540b0c2352025/cf/d45c3537d23e40df91bb44cfaaff6434 2023-10-01 22:01:47,082 INFO [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemState/ddb81fdef42088904cb030e83b5255cd/cf/841c5935b7e549efb968d48455b16785, entries=45, sequenceid=6, filesize=12.5 K 2023-10-01 22:01:47,083 INFO [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemState/c406354d6acaadb58ac540b0c2352025/cf/d45c3537d23e40df91bb44cfaaff6434, entries=5, sequenceid=6, filesize=5.7 K 2023-10-01 22:01:47,083 INFO [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for ddb81fdef42088904cb030e83b5255cd in 457ms, sequenceid=6, compaction requested=false 2023-10-01 22:01:47,085 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ddb81fdef42088904cb030e83b5255cd: 2023-10-01 22:01:47,085 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-01 22:01:47,085 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 22:01:47,085 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemState/ddb81fdef42088904cb030e83b5255cd/cf/841c5935b7e549efb968d48455b16785] hfiles 2023-10-01 22:01:47,085 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemState/ddb81fdef42088904cb030e83b5255cd/cf/841c5935b7e549efb968d48455b16785 for snapshot=snaptb0-testExportFileSystemState 2023-10-01 22:01:47,086 INFO [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for c406354d6acaadb58ac540b0c2352025 in 460ms, sequenceid=6, compaction requested=false 2023-10-01 22:01:47,086 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c406354d6acaadb58ac540b0c2352025: 2023-10-01 22:01:47,086 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-01 22:01:47,086 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 22:01:47,086 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemState/c406354d6acaadb58ac540b0c2352025/cf/d45c3537d23e40df91bb44cfaaff6434] hfiles 2023-10-01 22:01:47,087 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemState/c406354d6acaadb58ac540b0c2352025/cf/d45c3537d23e40df91bb44cfaaff6434 for snapshot=snaptb0-testExportFileSystemState 2023-10-01 22:01:47,112 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025. completed. 2023-10-01 22:01:47,112 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025. 2023-10-01 22:01:47,112 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 22:01:47,112 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 22:01:47,112 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:47,113 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-01 22:01:47,113 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42263,1696197680774' in zk 2023-10-01 22:01:47,113 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd. completed. 2023-10-01 22:01:47,113 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd. 2023-10-01 22:01:47,113 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 22:01:47,113 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 22:01:47,113 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:47,113 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-01 22:01:47,113 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39235,1696197680862' in zk 2023-10-01 22:01:47,117 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:47,117 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-01 22:01:47,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:47,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:01:47,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:01:47,117 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:01:47,118 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-01 22:01:47,119 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:47,119 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-01 22:01:47,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:01:47,120 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:01:47,120 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-01 22:01:47,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:01:47,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 22:01:47,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:47,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:47,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:47,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:01:47,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 22:01:47,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:47,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:47,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:47,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42263,1696197680774': 2023-10-01 22:01:47,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42263,1696197680774' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-01 22:01:47,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:47,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:01:47,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:01:47,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:01:47,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:01:47,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 22:01:47,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:47,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:47,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:47,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:01:47,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 22:01:47,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:47,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:47,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:47,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39235,1696197680862': 2023-10-01 22:01:47,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39235,1696197680862' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-01 22:01:47,129 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-10-01 22:01:47,129 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 22:01:47,129 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 22:01:47,129 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-10-01 22:01:47,129 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 22:01:47,132 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 22:01:47,132 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 22:01:47,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 22:01:47,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 22:01:47,132 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:01:47,132 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 22:01:47,132 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:01:47,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 22:01:47,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:01:47,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:01:47,132 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 22:01:47,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 22:01:47,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 22:01:47,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 22:01:47,133 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:01:47,133 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:47,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:01:47,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 22:01:47,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:01:47,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:01:47,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:01:47,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:01:47,133 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:47,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 22:01:47,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 22:01:47,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:01:47,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 22:01:47,134 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:47,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:01:47,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:01:47,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 22:01:47,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 22:01:47,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:47,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:47,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:47,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:01:47,136 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:47,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 22:01:47,137 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:47,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:47,137 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:47,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:47,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:47,140 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:47,140 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 22:01:47,140 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:01:47,140 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:47,140 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:47,140 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 22:01:47,140 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:01:47,140 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 22:01:47,140 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:01:47,140 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:01:47,140 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 22:01:47,140 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 22:01:47,140 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:01:47,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:01:47,140 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-10-01 22:01:47,140 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:01:47,142 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:01:47,142 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:01:47,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:01:47,142 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-01 22:01:47,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:01:47,143 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-01 22:01:47,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:01:47,142 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:01:47,143 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 22:01:47,143 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:01:47,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:01:47,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:01:47,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:01:47,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:01:47,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:01:47,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:01:47,144 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310019de7c75ec1794c57abcaf69d0597c1ce, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231001aa00691f61204da18d9820ad83375aca] mob files 2023-10-01 22:01:47,144 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310019de7c75ec1794c57abcaf69d0597c1ce 2023-10-01 22:01:47,144 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231001aa00691f61204da18d9820ad83375aca 2023-10-01 22:01:47,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:01:47,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:01:47,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-10-01 22:01:47,158 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-01 22:01:47,182 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-01 22:01:47,183 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-01 22:01:47,183 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-01 22:01:47,184 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-01 22:01:47,184 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696197706583Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696197707157 (+574 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1696197707157Loading Region manifests for snaptb0-testExportFileSystemState at 1696197707157Writing data manifest for snaptb0-testExportFileSystemState at 1696197707162 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1696197707173 (+11 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696197707183 (+10 ms) 2023-10-01 22:01:47,187 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-01 22:01:47,189 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 604 msec 2023-10-01 22:01:47,190 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 22:01:47,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 22:01:47,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 22:01:47,192 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197707192 2023-10-01 22:01:47,192 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36919, tgtDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197707192, rawTgtDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197707192, srcFsUri=hdfs://localhost:36919, srcDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9 2023-10-01 22:01:47,228 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36919, inputRoot=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9 2023-10-01 22:01:47,229 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_193624971_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197707192, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197707192/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-01 22:01:47,229 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36919, inputRoot=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9, snapshotDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-10-01 22:01:47,245 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197707192/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-01 22:01:47,282 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 22:01:47,283 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 22:01:47,284 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 22:01:47,284 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 22:01:48,179 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/hadoop-6982866849924724457.jar 2023-10-01 22:01:48,180 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 22:01:48,180 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 22:01:48,255 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/hadoop-6482213650651802270.jar 2023-10-01 22:01:48,256 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 22:01:48,256 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 22:01:48,257 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 22:01:48,257 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 22:01:48,258 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 22:01:48,258 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 22:01:48,258 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 22:01:48,259 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 22:01:48,260 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 22:01:48,260 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 22:01:48,261 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 22:01:48,262 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 22:01:48,262 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 22:01:48,263 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 22:01:48,263 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 22:01:48,264 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 22:01:48,265 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 22:01:48,266 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 22:01:48,267 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 22:01:48,267 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 22:01:48,268 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 22:01:48,269 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 22:01:48,270 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 22:01:49,140 WARN [Listener at jenkins-hbase4.apache.org/45715] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 22:01:49,143 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-10-01 22:01:49,146 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-01 22:01:49,742 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 22:01:49,742 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 22:01:49,749 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696197687246_0001_000001 (auth:SIMPLE) 2023-10-01 22:01:50,284 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696197687246_0002_000001 (auth:SIMPLE) 2023-10-01 22:01:50,800 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 22:01:54,388 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696197687246_0002_000001 (auth:SIMPLE) 2023-10-01 22:01:56,625 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696197687246_0002_000001 (auth:SIMPLE) 2023-10-01 22:01:59,839 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696197687246_0002_000001 (auth:SIMPLE) 2023-10-01 22:02:01,345 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 22:02:01,346 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 22:02:01,354 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-10-01 22:02:01,354 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 22:02:01,355 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 22:02:01,355 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1693241814_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-01 22:02:01,355 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(367): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-01 22:02:01,355 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(367): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-01 22:02:01,355 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1693241814_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197707192/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197707192/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-01 22:02:01,356 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(367): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197707192/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-01 22:02:01,356 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(367): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197707192/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-01 22:02:01,363 INFO [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-10-01 22:02:01,363 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-10-01 22:02:01,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-10-01 22:02:01,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-01 22:02:01,368 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696197721368"}]},"ts":"1696197721368"} 2023-10-01 22:02:01,370 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-10-01 22:02:01,372 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-10-01 22:02:01,373 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c406354d6acaadb58ac540b0c2352025, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ddb81fdef42088904cb030e83b5255cd, UNASSIGN}] 2023-10-01 22:02:01,375 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c406354d6acaadb58ac540b0c2352025, UNASSIGN 2023-10-01 22:02:01,375 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ddb81fdef42088904cb030e83b5255cd, UNASSIGN 2023-10-01 22:02:01,376 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=c406354d6acaadb58ac540b0c2352025, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:01,376 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=ddb81fdef42088904cb030e83b5255cd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:01,376 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696197721376"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696197721376"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696197721376"}]},"ts":"1696197721376"} 2023-10-01 22:02:01,376 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696197721376"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696197721376"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696197721376"}]},"ts":"1696197721376"} 2023-10-01 22:02:01,377 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure c406354d6acaadb58ac540b0c2352025, server=jenkins-hbase4.apache.org,42263,1696197680774}] 2023-10-01 22:02:01,378 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure ddb81fdef42088904cb030e83b5255cd, server=jenkins-hbase4.apache.org,39235,1696197680862}] 2023-10-01 22:02:01,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-01 22:02:01,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c406354d6acaadb58ac540b0c2352025 2023-10-01 22:02:01,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c406354d6acaadb58ac540b0c2352025, disabling compactions & flushes 2023-10-01 22:02:01,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025. 2023-10-01 22:02:01,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025. 2023-10-01 22:02:01,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025. after waiting 0 ms 2023-10-01 22:02:01,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025. 2023-10-01 22:02:01,534 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ddb81fdef42088904cb030e83b5255cd 2023-10-01 22:02:01,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ddb81fdef42088904cb030e83b5255cd, disabling compactions & flushes 2023-10-01 22:02:01,534 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd. 2023-10-01 22:02:01,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd. 2023-10-01 22:02:01,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd. after waiting 0 ms 2023-10-01 22:02:01,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd. 2023-10-01 22:02:01,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemState/c406354d6acaadb58ac540b0c2352025/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 22:02:01,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemState/ddb81fdef42088904cb030e83b5255cd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 22:02:01,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 22:02:01,541 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025. 2023-10-01 22:02:01,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c406354d6acaadb58ac540b0c2352025: 2023-10-01 22:02:01,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 22:02:01,542 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd. 2023-10-01 22:02:01,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ddb81fdef42088904cb030e83b5255cd: 2023-10-01 22:02:01,543 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c406354d6acaadb58ac540b0c2352025 2023-10-01 22:02:01,544 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=c406354d6acaadb58ac540b0c2352025, regionState=CLOSED 2023-10-01 22:02:01,544 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696197721544"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696197721544"}]},"ts":"1696197721544"} 2023-10-01 22:02:01,544 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ddb81fdef42088904cb030e83b5255cd 2023-10-01 22:02:01,545 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=ddb81fdef42088904cb030e83b5255cd, regionState=CLOSED 2023-10-01 22:02:01,545 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696197721545"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696197721545"}]},"ts":"1696197721545"} 2023-10-01 22:02:01,548 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-10-01 22:02:01,548 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure c406354d6acaadb58ac540b0c2352025, server=jenkins-hbase4.apache.org,42263,1696197680774 in 169 msec 2023-10-01 22:02:01,549 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-10-01 22:02:01,549 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure ddb81fdef42088904cb030e83b5255cd, server=jenkins-hbase4.apache.org,39235,1696197680862 in 169 msec 2023-10-01 22:02:01,549 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c406354d6acaadb58ac540b0c2352025, UNASSIGN in 175 msec 2023-10-01 22:02:01,551 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=38, resume processing ppid=36 2023-10-01 22:02:01,551 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ddb81fdef42088904cb030e83b5255cd, UNASSIGN in 176 msec 2023-10-01 22:02:01,552 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696197721552"}]},"ts":"1696197721552"} 2023-10-01 22:02:01,553 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-10-01 22:02:01,554 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-10-01 22:02:01,556 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 192 msec 2023-10-01 22:02:01,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-01 22:02:01,670 INFO [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-10-01 22:02:01,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-10-01 22:02:01,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-01 22:02:01,675 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-01 22:02:01,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-10-01 22:02:01,676 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-01 22:02:01,677 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37145] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-10-01 22:02:01,680 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 22:02:01,681 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 22:02:01,681 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemState/ddb81fdef42088904cb030e83b5255cd 2023-10-01 22:02:01,681 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 22:02:01,681 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemState/c406354d6acaadb58ac540b0c2352025 2023-10-01 22:02:01,681 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 22:02:01,681 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-01 22:02:01,681 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-01 22:02:01,681 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-01 22:02:01,682 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 22:02:01,682 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:01,682 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-10-01 22:02:01,682 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 22:02:01,682 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 22:02:01,682 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:01,682 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:01,682 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:01,682 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-01 22:02:01,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-01 22:02:01,684 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemState/ddb81fdef42088904cb030e83b5255cd/cf, FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemState/ddb81fdef42088904cb030e83b5255cd/recovered.edits] 2023-10-01 22:02:01,684 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemState/c406354d6acaadb58ac540b0c2352025/cf, FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemState/c406354d6acaadb58ac540b0c2352025/recovered.edits] 2023-10-01 22:02:01,688 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemState/ddb81fdef42088904cb030e83b5255cd/cf/841c5935b7e549efb968d48455b16785 to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testExportFileSystemState/ddb81fdef42088904cb030e83b5255cd/cf/841c5935b7e549efb968d48455b16785 2023-10-01 22:02:01,688 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemState/c406354d6acaadb58ac540b0c2352025/cf/d45c3537d23e40df91bb44cfaaff6434 to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testExportFileSystemState/c406354d6acaadb58ac540b0c2352025/cf/d45c3537d23e40df91bb44cfaaff6434 2023-10-01 22:02:01,691 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemState/ddb81fdef42088904cb030e83b5255cd/recovered.edits/9.seqid to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testExportFileSystemState/ddb81fdef42088904cb030e83b5255cd/recovered.edits/9.seqid 2023-10-01 22:02:01,692 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemState/c406354d6acaadb58ac540b0c2352025/recovered.edits/9.seqid to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testExportFileSystemState/c406354d6acaadb58ac540b0c2352025/recovered.edits/9.seqid 2023-10-01 22:02:01,692 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemState/ddb81fdef42088904cb030e83b5255cd 2023-10-01 22:02:01,692 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemState/c406354d6acaadb58ac540b0c2352025 2023-10-01 22:02:01,692 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-01 22:02:01,693 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-01 22:02:01,694 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-10-01 22:02:01,698 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310019de7c75ec1794c57abcaf69d0597c1ce to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310019de7c75ec1794c57abcaf69d0597c1ce 2023-10-01 22:02:01,700 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231001aa00691f61204da18d9820ad83375aca to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231001aa00691f61204da18d9820ad83375aca 2023-10-01 22:02:01,700 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-01 22:02:01,703 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-01 22:02:01,706 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-10-01 22:02:01,708 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-10-01 22:02:01,710 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-01 22:02:01,710 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-10-01 22:02:01,710 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696197721710"}]},"ts":"9223372036854775807"} 2023-10-01 22:02:01,710 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696197721710"}]},"ts":"9223372036854775807"} 2023-10-01 22:02:01,713 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-01 22:02:01,713 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c406354d6acaadb58ac540b0c2352025, NAME => 'testtb-testExportFileSystemState,,1696197705545.c406354d6acaadb58ac540b0c2352025.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ddb81fdef42088904cb030e83b5255cd, NAME => 'testtb-testExportFileSystemState,1,1696197705545.ddb81fdef42088904cb030e83b5255cd.', STARTKEY => '1', ENDKEY => ''}] 2023-10-01 22:02:01,713 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-10-01 22:02:01,713 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696197721713"}]},"ts":"9223372036854775807"} 2023-10-01 22:02:01,717 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-10-01 22:02:01,720 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-01 22:02:01,721 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 49 msec 2023-10-01 22:02:01,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-01 22:02:01,785 INFO [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-10-01 22:02:01,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-10-01 22:02:01,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-10-01 22:02:01,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-10-01 22:02:01,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemState 2023-10-01 22:02:01,825 INFO [Listener at jenkins-hbase4.apache.org/45715] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=763 (was 752) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1964 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1693241814_17 at /127.0.0.1:57254 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:42345 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1693241814_17 at /127.0.0.1:56702 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6cc451db-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6cc451db-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1528412535_1 at /127.0.0.1:36908 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:45715 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x6cc451db-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1693241814_17 at /127.0.0.1:36924 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6cc451db-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=935 (was 923) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=259 (was 191) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=1450 (was 1610) 2023-10-01 22:02:01,825 WARN [Listener at jenkins-hbase4.apache.org/45715] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-10-01 22:02:01,844 INFO [Listener at jenkins-hbase4.apache.org/45715] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=763, OpenFileDescriptor=935, MaxFileDescriptor=60000, SystemLoadAverage=259, ProcessCount=168, AvailableMemoryMB=1449 2023-10-01 22:02:01,844 WARN [Listener at jenkins-hbase4.apache.org/45715] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-10-01 22:02:01,846 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-01 22:02:01,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-10-01 22:02:01,851 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 22:02:01,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-10-01 22:02:01,851 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 22:02:01,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-01 22:02:01,854 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testConsecutiveExports/aef9a4be7399e2cdc851df041217dc7b 2023-10-01 22:02:01,854 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testConsecutiveExports/520864267e76780cb9271969eb33c9b0 2023-10-01 22:02:01,855 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testConsecutiveExports/aef9a4be7399e2cdc851df041217dc7b empty. 2023-10-01 22:02:01,855 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testConsecutiveExports/520864267e76780cb9271969eb33c9b0 empty. 2023-10-01 22:02:01,856 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testConsecutiveExports/aef9a4be7399e2cdc851df041217dc7b 2023-10-01 22:02:01,856 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testConsecutiveExports/520864267e76780cb9271969eb33c9b0 2023-10-01 22:02:01,856 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-01 22:02:01,869 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-10-01 22:02:01,871 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => aef9a4be7399e2cdc851df041217dc7b, NAME => 'testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp 2023-10-01 22:02:01,871 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 520864267e76780cb9271969eb33c9b0, NAME => 'testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp 2023-10-01 22:02:01,886 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:02:01,887 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing aef9a4be7399e2cdc851df041217dc7b, disabling compactions & flushes 2023-10-01 22:02:01,887 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b. 2023-10-01 22:02:01,887 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b. 2023-10-01 22:02:01,887 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b. after waiting 0 ms 2023-10-01 22:02:01,887 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b. 2023-10-01 22:02:01,887 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b. 2023-10-01 22:02:01,887 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for aef9a4be7399e2cdc851df041217dc7b: 2023-10-01 22:02:01,888 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:02:01,888 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 520864267e76780cb9271969eb33c9b0, disabling compactions & flushes 2023-10-01 22:02:01,888 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0. 2023-10-01 22:02:01,888 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0. 2023-10-01 22:02:01,888 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0. after waiting 0 ms 2023-10-01 22:02:01,888 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0. 2023-10-01 22:02:01,888 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0. 2023-10-01 22:02:01,888 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 520864267e76780cb9271969eb33c9b0: 2023-10-01 22:02:01,890 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 22:02:01,891 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696197721891"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696197721891"}]},"ts":"1696197721891"} 2023-10-01 22:02:01,891 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696197721891"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696197721891"}]},"ts":"1696197721891"} 2023-10-01 22:02:01,894 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 22:02:01,895 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 22:02:01,895 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696197721895"}]},"ts":"1696197721895"} 2023-10-01 22:02:01,896 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-10-01 22:02:01,901 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 22:02:01,902 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 22:02:01,902 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 22:02:01,902 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 22:02:01,902 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 22:02:01,902 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=aef9a4be7399e2cdc851df041217dc7b, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=520864267e76780cb9271969eb33c9b0, ASSIGN}] 2023-10-01 22:02:01,905 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=aef9a4be7399e2cdc851df041217dc7b, ASSIGN 2023-10-01 22:02:01,905 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=520864267e76780cb9271969eb33c9b0, ASSIGN 2023-10-01 22:02:01,906 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=aef9a4be7399e2cdc851df041217dc7b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42263,1696197680774; forceNewPlan=false, retain=false 2023-10-01 22:02:01,906 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=520864267e76780cb9271969eb33c9b0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37145,1696197680825; forceNewPlan=false, retain=false 2023-10-01 22:02:01,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-01 22:02:02,056 INFO [jenkins-hbase4:40311] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 22:02:02,059 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=aef9a4be7399e2cdc851df041217dc7b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,059 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=520864267e76780cb9271969eb33c9b0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,059 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696197722059"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696197722059"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696197722059"}]},"ts":"1696197722059"} 2023-10-01 22:02:02,059 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696197722059"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696197722059"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696197722059"}]},"ts":"1696197722059"} 2023-10-01 22:02:02,061 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure aef9a4be7399e2cdc851df041217dc7b, server=jenkins-hbase4.apache.org,42263,1696197680774}] 2023-10-01 22:02:02,062 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 520864267e76780cb9271969eb33c9b0, server=jenkins-hbase4.apache.org,37145,1696197680825}] 2023-10-01 22:02:02,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-01 22:02:02,216 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0. 2023-10-01 22:02:02,216 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b. 2023-10-01 22:02:02,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 520864267e76780cb9271969eb33c9b0, NAME => 'testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0.', STARTKEY => '1', ENDKEY => ''} 2023-10-01 22:02:02,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => aef9a4be7399e2cdc851df041217dc7b, NAME => 'testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b.', STARTKEY => '', ENDKEY => '1'} 2023-10-01 22:02:02,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0. service=AccessControlService 2023-10-01 22:02:02,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b. service=AccessControlService 2023-10-01 22:02:02,217 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 22:02:02,217 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 22:02:02,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 520864267e76780cb9271969eb33c9b0 2023-10-01 22:02:02,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports aef9a4be7399e2cdc851df041217dc7b 2023-10-01 22:02:02,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:02:02,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:02:02,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 520864267e76780cb9271969eb33c9b0 2023-10-01 22:02:02,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for aef9a4be7399e2cdc851df041217dc7b 2023-10-01 22:02:02,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 520864267e76780cb9271969eb33c9b0 2023-10-01 22:02:02,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for aef9a4be7399e2cdc851df041217dc7b 2023-10-01 22:02:02,219 INFO [StoreOpener-520864267e76780cb9271969eb33c9b0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 520864267e76780cb9271969eb33c9b0 2023-10-01 22:02:02,219 INFO [StoreOpener-aef9a4be7399e2cdc851df041217dc7b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region aef9a4be7399e2cdc851df041217dc7b 2023-10-01 22:02:02,220 DEBUG [StoreOpener-520864267e76780cb9271969eb33c9b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testConsecutiveExports/520864267e76780cb9271969eb33c9b0/cf 2023-10-01 22:02:02,220 DEBUG [StoreOpener-aef9a4be7399e2cdc851df041217dc7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testConsecutiveExports/aef9a4be7399e2cdc851df041217dc7b/cf 2023-10-01 22:02:02,220 DEBUG [StoreOpener-520864267e76780cb9271969eb33c9b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testConsecutiveExports/520864267e76780cb9271969eb33c9b0/cf 2023-10-01 22:02:02,220 DEBUG [StoreOpener-aef9a4be7399e2cdc851df041217dc7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testConsecutiveExports/aef9a4be7399e2cdc851df041217dc7b/cf 2023-10-01 22:02:02,221 INFO [StoreOpener-520864267e76780cb9271969eb33c9b0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 520864267e76780cb9271969eb33c9b0 columnFamilyName cf 2023-10-01 22:02:02,221 INFO [StoreOpener-aef9a4be7399e2cdc851df041217dc7b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aef9a4be7399e2cdc851df041217dc7b columnFamilyName cf 2023-10-01 22:02:02,222 INFO [StoreOpener-520864267e76780cb9271969eb33c9b0-1] regionserver.HStore(310): Store=520864267e76780cb9271969eb33c9b0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 22:02:02,222 INFO [StoreOpener-aef9a4be7399e2cdc851df041217dc7b-1] regionserver.HStore(310): Store=aef9a4be7399e2cdc851df041217dc7b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 22:02:02,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testConsecutiveExports/aef9a4be7399e2cdc851df041217dc7b 2023-10-01 22:02:02,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testConsecutiveExports/520864267e76780cb9271969eb33c9b0 2023-10-01 22:02:02,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testConsecutiveExports/aef9a4be7399e2cdc851df041217dc7b 2023-10-01 22:02:02,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testConsecutiveExports/520864267e76780cb9271969eb33c9b0 2023-10-01 22:02:02,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for aef9a4be7399e2cdc851df041217dc7b 2023-10-01 22:02:02,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 520864267e76780cb9271969eb33c9b0 2023-10-01 22:02:02,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testConsecutiveExports/520864267e76780cb9271969eb33c9b0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 22:02:02,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testConsecutiveExports/aef9a4be7399e2cdc851df041217dc7b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 22:02:02,229 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 520864267e76780cb9271969eb33c9b0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59286574, jitterRate=-0.11656120419502258}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 22:02:02,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 520864267e76780cb9271969eb33c9b0: 2023-10-01 22:02:02,229 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened aef9a4be7399e2cdc851df041217dc7b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61381187, jitterRate=-0.08534903824329376}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 22:02:02,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for aef9a4be7399e2cdc851df041217dc7b: 2023-10-01 22:02:02,230 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0., pid=46, masterSystemTime=1696197722213 2023-10-01 22:02:02,230 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b., pid=45, masterSystemTime=1696197722213 2023-10-01 22:02:02,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0. 2023-10-01 22:02:02,234 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0. 2023-10-01 22:02:02,235 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=520864267e76780cb9271969eb33c9b0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,235 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696197722234"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696197722234"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696197722234"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696197722234"}]},"ts":"1696197722234"} 2023-10-01 22:02:02,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b. 2023-10-01 22:02:02,235 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b. 2023-10-01 22:02:02,236 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=aef9a4be7399e2cdc851df041217dc7b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,236 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696197722235"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696197722235"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696197722235"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696197722235"}]},"ts":"1696197722235"} 2023-10-01 22:02:02,239 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-10-01 22:02:02,239 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 520864267e76780cb9271969eb33c9b0, server=jenkins-hbase4.apache.org,37145,1696197680825 in 175 msec 2023-10-01 22:02:02,240 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-10-01 22:02:02,240 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure aef9a4be7399e2cdc851df041217dc7b, server=jenkins-hbase4.apache.org,42263,1696197680774 in 177 msec 2023-10-01 22:02:02,241 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=520864267e76780cb9271969eb33c9b0, ASSIGN in 337 msec 2023-10-01 22:02:02,242 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=43, resume processing ppid=42 2023-10-01 22:02:02,242 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=aef9a4be7399e2cdc851df041217dc7b, ASSIGN in 338 msec 2023-10-01 22:02:02,243 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 22:02:02,243 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696197722243"}]},"ts":"1696197722243"} 2023-10-01 22:02:02,244 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-10-01 22:02:02,246 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 22:02:02,247 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-10-01 22:02:02,248 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37145] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-01 22:02:02,250 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:02,250 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:02,250 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:02,250 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:02,251 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-01 22:02:02,251 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-01 22:02:02,251 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-01 22:02:02,252 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-01 22:02:02,253 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 404 msec 2023-10-01 22:02:02,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-01 22:02:02,456 INFO [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-10-01 22:02:02,458 DEBUG [Listener at jenkins-hbase4.apache.org/45715] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-01 22:02:02,458 DEBUG [Listener at jenkins-hbase4.apache.org/45715] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b. 2023-10-01 22:02:02,460 INFO [Listener at jenkins-hbase4.apache.org/45715] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 22:02:02,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-01 22:02:02,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696197722471 (current time:1696197722471). 2023-10-01 22:02:02,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 22:02:02,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(139): Connect 0x37cce6c5 to 127.0.0.1:58905 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 22:02:02,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c5b3f1a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 22:02:02,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:02:02,485 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35632, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:02:02,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37cce6c5 to 127.0.0.1:58905 2023-10-01 22:02:02,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:02:02,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(139): Connect 0x6e48ecab to 127.0.0.1:58905 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 22:02:02,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e62c569, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 22:02:02,494 DEBUG [hconnection-0x6b948e50-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:02:02,496 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35638, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:02:02,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:02:02,502 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42022, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:02:02,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e48ecab to 127.0.0.1:58905 2023-10-01 22:02:02,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:02:02,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-01 22:02:02,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 22:02:02,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-01 22:02:02,506 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot, current working dir path: hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 22:02:02,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-01 22:02:02,508 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-01 22:02:02,509 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696198322509 2023-10-01 22:02:02,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-01 22:02:02,509 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-01 22:02:02,510 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 22:02:02,511 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 22:02:02,514 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-01 22:02:02,514 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-01 22:02:02,515 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-10-01 22:02:02,516 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-01 22:02:02,516 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696198322516 2023-10-01 22:02:02,528 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,528 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-10-01 22:02:02,528 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:02,529 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-10-01 22:02:02,529 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-01 22:02:02,530 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,530 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,531 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:02,532 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:02,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:02,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:02,532 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,532 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:02,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:02,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:02,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:02,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:02,532 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,532 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,532 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,532 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 22:02:02,533 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,533 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,533 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-01 22:02:02,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-01 22:02:02,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-01 22:02:02,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,533 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-01 22:02:02,533 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-01 22:02:02,533 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-01 22:02:02,533 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,534 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,534 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-01 22:02:02,534 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-01 22:02:02,534 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:02,534 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:02,535 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-01 22:02:02,535 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-01 22:02:02,535 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-01 22:02:02,534 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,535 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37145,1696197680825' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-01 22:02:02,536 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-01 22:02:02,536 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:02,535 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-01 22:02:02,538 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42263,1696197680774' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-01 22:02:02,538 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-01 22:02:02,538 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-01 22:02:02,538 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39235,1696197680862' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-01 22:02:02,540 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,540 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:02,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:02,540 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,540 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,540 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,540 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:02,541 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:02:02,541 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,541 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:02:02,541 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:02,541 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:02:02,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:02,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:02,542 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37145,1696197680825' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-01 22:02:02,542 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@119847a0[Count = 1] remaining members to acquire global barrier 2023-10-01 22:02:02,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:02,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:02,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:02,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:02,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:02,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:02,544 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42263,1696197680774' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-01 22:02:02,544 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@119847a0[Count = 0] remaining members to acquire global barrier 2023-10-01 22:02:02,544 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-01 22:02:02,544 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,545 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,545 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,545 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,545 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,545 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-01 22:02:02,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,546 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-01 22:02:02,546 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-01 22:02:02,546 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-01 22:02:02,546 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39235,1696197680862' in zk 2023-10-01 22:02:02,546 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b. 2023-10-01 22:02:02,546 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 22:02:02,546 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b. started... 2023-10-01 22:02:02,546 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0. 2023-10-01 22:02:02,546 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 22:02:02,546 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0. started... 2023-10-01 22:02:02,546 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 22:02:02,546 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 22:02:02,546 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,547 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 520864267e76780cb9271969eb33c9b0: 2023-10-01 22:02:02,547 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 22:02:02,546 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for aef9a4be7399e2cdc851df041217dc7b: 2023-10-01 22:02:02,547 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,547 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,547 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 22:02:02,547 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 22:02:02,547 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 22:02:02,547 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 22:02:02,555 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-01 22:02:02,555 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:02,555 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-01 22:02:02,569 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0. completed. 2023-10-01 22:02:02,569 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0. 2023-10-01 22:02:02,569 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 22:02:02,569 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 22:02:02,569 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,569 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-01 22:02:02,569 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37145,1696197680825' in zk 2023-10-01 22:02:02,571 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-01 22:02:02,571 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,571 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:02,571 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-01 22:02:02,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:02,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:02,572 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b. completed. 2023-10-01 22:02:02,572 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b. 2023-10-01 22:02:02,572 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 22:02:02,572 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 22:02:02,572 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,573 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-01 22:02:02,573 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42263,1696197680774' in zk 2023-10-01 22:02:02,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:02,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:02,574 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,574 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-01 22:02:02,574 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:02,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,574 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-01 22:02:02,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:02,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:02,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:02,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37145,1696197680825': 2023-10-01 22:02:02,578 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37145,1696197680825' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-01 22:02:02,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:02,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:02,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:02,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:02,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:02,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:02,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:02,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,42263,1696197680774': 2023-10-01 22:02:02,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42263,1696197680774' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-01 22:02:02,581 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-10-01 22:02:02,581 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 22:02:02,581 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 22:02:02,581 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,581 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 22:02:02,583 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,583 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,583 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,583 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,583 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:02,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:02,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:02,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,583 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:02,583 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,583 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:02,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:02,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:02,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:02,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:02,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:02,584 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:02,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:02,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:02,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,584 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:02,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:02,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,586 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:02,586 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:02,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,587 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:02,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,592 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,592 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,592 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:02,592 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:02,592 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:02,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:02,592 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:02,592 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:02,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:02,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:02,592 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:02,592 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:02,592 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:02,592 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-01 22:02:02,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:02,592 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:02,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:02,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:02,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:02,592 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:02,594 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 22:02:02,592 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:02,594 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,594 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,594 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,594 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:02,594 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,594 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,594 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:02,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:02,594 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-01 22:02:02,602 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,603 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,611 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 22:02:02,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-01 22:02:02,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-01 22:02:02,612 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 22:02:02,623 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,623 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-01 22:02:02,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,624 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:02,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696197722509Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696197722602 (+93 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1696197722602Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1696197722602Writing data manifest for emptySnaptb0-testConsecutiveExports at 1696197722606 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1696197722617 (+11 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696197722623 (+6 ms) 2023-10-01 22:02:02,626 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-01 22:02:02,628 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 116 msec 2023-10-01 22:02:02,812 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 22:02:02,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-01 22:02:02,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 22:02:02,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42263] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 22:02:02,818 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37145] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 22:02:02,821 DEBUG [Listener at jenkins-hbase4.apache.org/45715] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-01 22:02:02,821 DEBUG [Listener at jenkins-hbase4.apache.org/45715] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b. 2023-10-01 22:02:02,821 INFO [Listener at jenkins-hbase4.apache.org/45715] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 22:02:02,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-01 22:02:02,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696197722831 (current time:1696197722831). 2023-10-01 22:02:02,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 22:02:02,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(139): Connect 0x7e2087c0 to 127.0.0.1:58905 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 22:02:02,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79f55b0b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 22:02:02,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:02:02,846 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35652, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:02:02,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e2087c0 to 127.0.0.1:58905 2023-10-01 22:02:02,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:02:02,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(139): Connect 0x6a319007 to 127.0.0.1:58905 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 22:02:02,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10d51406, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 22:02:02,867 DEBUG [hconnection-0x432b3814-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:02:02,870 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35660, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:02:02,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:02:02,874 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42024, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:02:02,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a319007 to 127.0.0.1:58905 2023-10-01 22:02:02,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:02:02,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-01 22:02:02,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 22:02:02,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-01 22:02:02,879 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot, current working dir path: hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 22:02:02,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-01 22:02:02,881 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-01 22:02:02,882 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696198322882 2023-10-01 22:02:02,882 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-01 22:02:02,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-01 22:02:02,884 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 22:02:02,884 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 22:02:02,885 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-01 22:02:02,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-01 22:02:02,886 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-10-01 22:02:02,887 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-01 22:02:02,888 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696198322888 2023-10-01 22:02:02,902 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-10-01 22:02:02,902 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-10-01 22:02:02,902 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:02,903 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-10-01 22:02:02,903 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-01 22:02:02,904 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 22:02:02,904 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 22:02:02,905 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,905 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:02,905 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:02,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:02,905 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:02,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:02,905 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,906 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:02,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:02,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:02,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:02,906 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,906 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 22:02:02,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 22:02:02,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 22:02:02,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 22:02:02,906 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 22:02:02,907 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 22:02:02,907 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 22:02:02,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-01 22:02:02,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 22:02:02,907 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-01 22:02:02,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-01 22:02:02,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 22:02:02,907 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-01 22:02:02,907 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-01 22:02:02,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-01 22:02:02,907 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-01 22:02:02,907 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-01 22:02:02,908 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-01 22:02:02,908 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:02,908 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:02,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 22:02:02,910 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-01 22:02:02,910 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-01 22:02:02,909 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-01 22:02:02,910 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-01 22:02:02,910 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37145,1696197680825' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-01 22:02:02,910 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-01 22:02:02,910 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42263,1696197680774' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-01 22:02:02,910 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-01 22:02:02,910 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-01 22:02:02,910 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:02,911 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-01 22:02:02,911 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-01 22:02:02,911 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39235,1696197680862' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-01 22:02:02,912 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 22:02:02,912 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:02,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:02,913 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:02,913 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 22:02:02,913 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 22:02:02,913 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:02:02,915 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 22:02:02,915 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 22:02:02,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:02,915 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:02:02,915 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 22:02:02,915 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:02:02,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 22:02:02,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:02,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:02,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37145,1696197680825' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-01 22:02:02,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7141cc26[Count = 1] remaining members to acquire global barrier 2023-10-01 22:02:02,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:02,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:02,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:02,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:02,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 22:02:02,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:02,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:02,919 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42263,1696197680774' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-01 22:02:02,919 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7141cc26[Count = 0] remaining members to acquire global barrier 2023-10-01 22:02:02,919 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-01 22:02:02,919 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 22:02:02,920 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 22:02:02,920 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 22:02:02,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 22:02:02,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 22:02:02,920 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 22:02:02,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 22:02:02,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 22:02:02,920 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-01 22:02:02,920 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 22:02:02,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 22:02:02,920 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-01 22:02:02,920 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-01 22:02:02,920 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0. 2023-10-01 22:02:02,920 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-01 22:02:02,920 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 22:02:02,920 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 22:02:02,920 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39235,1696197680862' in zk 2023-10-01 22:02:02,920 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0. started... 2023-10-01 22:02:02,921 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,921 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 22:02:02,921 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b. 2023-10-01 22:02:02,921 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 22:02:02,921 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b. started... 2023-10-01 22:02:02,921 INFO [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 520864267e76780cb9271969eb33c9b0 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-10-01 22:02:02,921 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 22:02:02,921 INFO [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HRegion(2745): Flushing aef9a4be7399e2cdc851df041217dc7b 1/1 column families, dataSize=199 B heapSize=688 B 2023-10-01 22:02:02,922 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-01 22:02:02,922 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:02,922 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-01 22:02:02,949 INFO [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310018a98a81f3e7a4063b51f30914c255535 to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310018a98a81f3e7a4063b51f30914c255535 2023-10-01 22:02:02,956 INFO [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023100159ca611aab934e65aaf4f467db8bb760 to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100159ca611aab934e65aaf4f467db8bb760 2023-10-01 22:02:02,961 INFO [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testConsecutiveExports/aef9a4be7399e2cdc851df041217dc7b/.tmp/cf/d962520dde8b431aad9729ebecc922a8 2023-10-01 22:02:02,967 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testConsecutiveExports/aef9a4be7399e2cdc851df041217dc7b/.tmp/cf/d962520dde8b431aad9729ebecc922a8 as hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testConsecutiveExports/aef9a4be7399e2cdc851df041217dc7b/cf/d962520dde8b431aad9729ebecc922a8 2023-10-01 22:02:02,967 INFO [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testConsecutiveExports/520864267e76780cb9271969eb33c9b0/.tmp/cf/56dd2f7d87e94e93a756f70944c5ba8b 2023-10-01 22:02:02,972 INFO [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testConsecutiveExports/aef9a4be7399e2cdc851df041217dc7b/cf/d962520dde8b431aad9729ebecc922a8, entries=3, sequenceid=6, filesize=5.4 K 2023-10-01 22:02:02,973 INFO [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for aef9a4be7399e2cdc851df041217dc7b in 52ms, sequenceid=6, compaction requested=false 2023-10-01 22:02:02,973 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-10-01 22:02:02,973 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testConsecutiveExports/520864267e76780cb9271969eb33c9b0/.tmp/cf/56dd2f7d87e94e93a756f70944c5ba8b as hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testConsecutiveExports/520864267e76780cb9271969eb33c9b0/cf/56dd2f7d87e94e93a756f70944c5ba8b 2023-10-01 22:02:02,973 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for aef9a4be7399e2cdc851df041217dc7b: 2023-10-01 22:02:02,974 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-01 22:02:02,974 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 22:02:02,974 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testConsecutiveExports/aef9a4be7399e2cdc851df041217dc7b/cf/d962520dde8b431aad9729ebecc922a8] hfiles 2023-10-01 22:02:02,974 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testConsecutiveExports/aef9a4be7399e2cdc851df041217dc7b/cf/d962520dde8b431aad9729ebecc922a8 for snapshot=snaptb0-testConsecutiveExports 2023-10-01 22:02:02,978 INFO [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testConsecutiveExports/520864267e76780cb9271969eb33c9b0/cf/56dd2f7d87e94e93a756f70944c5ba8b, entries=47, sequenceid=6, filesize=12.7 K 2023-10-01 22:02:02,979 INFO [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 520864267e76780cb9271969eb33c9b0 in 58ms, sequenceid=6, compaction requested=false 2023-10-01 22:02:02,981 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 520864267e76780cb9271969eb33c9b0: 2023-10-01 22:02:02,981 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-01 22:02:02,981 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 22:02:02,981 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testConsecutiveExports/520864267e76780cb9271969eb33c9b0/cf/56dd2f7d87e94e93a756f70944c5ba8b] hfiles 2023-10-01 22:02:02,981 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testConsecutiveExports/520864267e76780cb9271969eb33c9b0/cf/56dd2f7d87e94e93a756f70944c5ba8b for snapshot=snaptb0-testConsecutiveExports 2023-10-01 22:02:02,983 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b. completed. 2023-10-01 22:02:02,983 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b. 2023-10-01 22:02:02,983 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 22:02:02,983 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 22:02:02,983 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,983 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-01 22:02:02,983 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42263,1696197680774' in zk 2023-10-01 22:02:02,984 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 22:02:02,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-01 22:02:02,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-01 22:02:02,985 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,985 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 22:02:02,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:02,985 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-01 22:02:02,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:02,986 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:02,986 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-01 22:02:02,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:02,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:02,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 22:02:02,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:02,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:02,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 22:02:02,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,991 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0. completed. 2023-10-01 22:02:02,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:02,991 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0. 2023-10-01 22:02:02,991 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 22:02:02,991 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 22:02:02,991 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,991 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-01 22:02:02,991 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37145,1696197680825' in zk 2023-10-01 22:02:02,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,42263,1696197680774': 2023-10-01 22:02:02,992 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42263,1696197680774' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-01 22:02:02,994 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-01 22:02:02,994 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,994 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:02,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:02,994 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-01 22:02:02,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:02,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:02,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:02,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 22:02:02,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:02,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:02,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 22:02:02,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:02,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:02,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:02,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37145,1696197680825': 2023-10-01 22:02:02,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37145,1696197680825' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-01 22:02:02,998 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-10-01 22:02:02,998 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 22:02:02,999 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 22:02:02,999 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-10-01 22:02:02,999 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 22:02:03,000 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 22:02:03,000 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 22:02:03,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 22:02:03,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 22:02:03,000 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 22:02:03,000 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 22:02:03,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 22:02:03,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:03,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:03,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 22:02:03,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 22:02:03,000 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:03,001 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:03,000 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:03,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 22:02:03,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 22:02:03,001 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:03,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:03,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:03,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:03,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:03,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:03,002 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:03,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 22:02:03,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 22:02:03,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 22:02:03,002 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:03,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:03,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 22:02:03,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:03,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:03,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:03,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 22:02:03,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:03,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:03,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:03,004 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:03,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 22:02:03,005 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:03,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:03,005 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:03,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:03,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:03,011 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:03,012 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:03,011 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:03,012 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 22:02:03,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:03,012 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:03,012 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:03,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:03,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:03,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:03,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:03,012 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-10-01 22:02:03,012 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:03,012 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-01 22:02:03,012 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:03,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:03,012 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:03,012 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:03,014 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:03,014 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 22:02:03,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-01 22:02:03,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 22:02:03,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:03,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:03,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:03,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:03,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:03,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:03,014 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:03,015 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 22:02:03,015 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:03,015 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:03,015 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 22:02:03,015 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 22:02:03,015 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100159ca611aab934e65aaf4f467db8bb760, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310018a98a81f3e7a4063b51f30914c255535] mob files 2023-10-01 22:02:03,015 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100159ca611aab934e65aaf4f467db8bb760 2023-10-01 22:02:03,015 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310018a98a81f3e7a4063b51f30914c255535 2023-10-01 22:02:03,027 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-10-01 22:02:03,028 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 22:02:03,048 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-01 22:02:03,049 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-01 22:02:03,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 22:02:03,049 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 22:02:03,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696197722882Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696197723027 (+145 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1696197723027Loading Region manifests for snaptb0-testConsecutiveExports at 1696197723027Writing data manifest for snaptb0-testConsecutiveExports at 1696197723032 (+5 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1696197723041 (+9 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696197723049 (+8 ms) 2023-10-01 22:02:03,052 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-01 22:02:03,053 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 169 msec 2023-10-01 22:02:03,186 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 22:02:03,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-01 22:02:03,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 22:02:03,187 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/local-export-1696197723187 2023-10-01 22:02:03,187 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/local-export-1696197723187, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/local-export-1696197723187, srcFsUri=hdfs://localhost:36919, srcDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9 2023-10-01 22:02:03,209 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36919, inputRoot=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9 2023-10-01 22:02:03,209 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@3657ee6c, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/local-export-1696197723187, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/local-export-1696197723187/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 22:02:03,209 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36919, inputRoot=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9, snapshotDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-01 22:02:03,217 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/local-export-1696197723187/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 22:02:03,229 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:03,229 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:03,230 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:03,230 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:04,111 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/hadoop-7041797859330956471.jar 2023-10-01 22:02:04,111 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:04,112 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:04,178 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/hadoop-501880325086000353.jar 2023-10-01 22:02:04,178 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:04,179 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:04,179 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:04,179 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:04,180 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:04,180 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:04,180 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 22:02:04,181 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 22:02:04,181 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 22:02:04,182 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 22:02:04,182 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 22:02:04,182 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 22:02:04,183 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 22:02:04,183 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 22:02:04,183 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 22:02:04,184 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 22:02:04,185 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 22:02:04,185 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 22:02:04,186 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 22:02:04,186 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 22:02:04,186 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 22:02:04,187 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 22:02:04,188 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 22:02:04,561 WARN [Listener at jenkins-hbase4.apache.org/45715] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 22:02:04,564 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-01 22:02:04,566 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-01 22:02:06,009 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 22:02:06,009 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 22:02:06,012 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696197687246_0002_000001 (auth:SIMPLE) 2023-10-01 22:02:06,810 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696197687246_0003_000001 (auth:SIMPLE) 2023-10-01 22:02:07,120 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 22:02:10,545 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696197687246_0003_000001 (auth:SIMPLE) 2023-10-01 22:02:12,767 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696197687246_0003_000001 (auth:SIMPLE) 2023-10-01 22:02:15,078 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696197687246_0003_000001 (auth:SIMPLE) 2023-10-01 22:02:16,753 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 22:02:16,753 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 22:02:16,757 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-01 22:02:16,758 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 22:02:16,758 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 22:02:16,758 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1693241814_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-01 22:02:16,761 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(367): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-01 22:02:16,761 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(367): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-01 22:02:16,761 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@3852e855 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/local-export-1696197723187/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/local-export-1696197723187/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-01 22:02:16,761 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/local-export-1696197723187/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-01 22:02:16,761 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/local-export-1696197723187/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-01 22:02:16,762 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/local-export-1696197723187, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/local-export-1696197723187, srcFsUri=hdfs://localhost:36919, srcDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9 2023-10-01 22:02:16,784 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36919, inputRoot=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9 2023-10-01 22:02:16,784 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@6cf4d455, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/local-export-1696197723187, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/local-export-1696197723187/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 22:02:16,784 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36919, inputRoot=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9, snapshotDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-01 22:02:16,794 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/local-export-1696197723187/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 22:02:16,805 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:16,806 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:16,806 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:16,806 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:17,675 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/hadoop-4103147059874355234.jar 2023-10-01 22:02:17,676 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:17,676 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:17,742 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/hadoop-6559881246712210594.jar 2023-10-01 22:02:17,743 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:17,743 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:17,743 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:17,744 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:17,744 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:17,744 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:17,745 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 22:02:17,745 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 22:02:17,746 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 22:02:17,746 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 22:02:17,746 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 22:02:17,747 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 22:02:17,747 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 22:02:17,747 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 22:02:17,748 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 22:02:17,748 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 22:02:17,749 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 22:02:17,749 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 22:02:17,750 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 22:02:17,750 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 22:02:17,750 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 22:02:17,751 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 22:02:17,751 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 22:02:18,130 WARN [Listener at jenkins-hbase4.apache.org/45715] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 22:02:18,132 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-01 22:02:18,134 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-01 22:02:21,248 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 22:02:21,248 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 22:02:21,251 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696197687246_0003_000001 (auth:SIMPLE) 2023-10-01 22:02:22,021 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696197687246_0004_000001 (auth:SIMPLE) 2023-10-01 22:02:25,732 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696197687246_0004_000001 (auth:SIMPLE) 2023-10-01 22:02:27,938 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696197687246_0004_000001 (auth:SIMPLE) 2023-10-01 22:02:30,097 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696197687246_0004_000001 (auth:SIMPLE) 2023-10-01 22:02:31,284 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 22:02:31,284 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 22:02:31,288 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-01 22:02:31,288 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 22:02:31,288 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 22:02:31,288 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1693241814_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-01 22:02:31,292 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(367): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-01 22:02:31,292 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(367): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-01 22:02:31,292 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@3852e855 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/local-export-1696197723187/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/local-export-1696197723187/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-01 22:02:31,292 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/local-export-1696197723187/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-01 22:02:31,292 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/local-export-1696197723187/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-01 22:02:31,304 INFO [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-10-01 22:02:31,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-10-01 22:02:31,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-10-01 22:02:31,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-01 22:02:31,309 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696197751308"}]},"ts":"1696197751308"} 2023-10-01 22:02:31,310 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-10-01 22:02:31,312 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-10-01 22:02:31,313 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=aef9a4be7399e2cdc851df041217dc7b, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=520864267e76780cb9271969eb33c9b0, UNASSIGN}] 2023-10-01 22:02:31,315 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=aef9a4be7399e2cdc851df041217dc7b, UNASSIGN 2023-10-01 22:02:31,315 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=520864267e76780cb9271969eb33c9b0, UNASSIGN 2023-10-01 22:02:31,316 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=aef9a4be7399e2cdc851df041217dc7b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:31,316 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=520864267e76780cb9271969eb33c9b0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:31,316 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696197751316"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696197751316"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696197751316"}]},"ts":"1696197751316"} 2023-10-01 22:02:31,316 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696197751316"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696197751316"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696197751316"}]},"ts":"1696197751316"} 2023-10-01 22:02:31,317 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure aef9a4be7399e2cdc851df041217dc7b, server=jenkins-hbase4.apache.org,42263,1696197680774}] 2023-10-01 22:02:31,318 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 520864267e76780cb9271969eb33c9b0, server=jenkins-hbase4.apache.org,37145,1696197680825}] 2023-10-01 22:02:31,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-01 22:02:31,469 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 520864267e76780cb9271969eb33c9b0 2023-10-01 22:02:31,469 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close aef9a4be7399e2cdc851df041217dc7b 2023-10-01 22:02:31,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 520864267e76780cb9271969eb33c9b0, disabling compactions & flushes 2023-10-01 22:02:31,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing aef9a4be7399e2cdc851df041217dc7b, disabling compactions & flushes 2023-10-01 22:02:31,469 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0. 2023-10-01 22:02:31,469 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b. 2023-10-01 22:02:31,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b. 2023-10-01 22:02:31,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0. 2023-10-01 22:02:31,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b. after waiting 0 ms 2023-10-01 22:02:31,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b. 2023-10-01 22:02:31,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0. after waiting 0 ms 2023-10-01 22:02:31,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0. 2023-10-01 22:02:31,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testConsecutiveExports/aef9a4be7399e2cdc851df041217dc7b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 22:02:31,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testConsecutiveExports/520864267e76780cb9271969eb33c9b0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 22:02:31,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 22:02:31,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 22:02:31,484 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b. 2023-10-01 22:02:31,484 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0. 2023-10-01 22:02:31,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for aef9a4be7399e2cdc851df041217dc7b: 2023-10-01 22:02:31,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 520864267e76780cb9271969eb33c9b0: 2023-10-01 22:02:31,485 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed aef9a4be7399e2cdc851df041217dc7b 2023-10-01 22:02:31,486 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=aef9a4be7399e2cdc851df041217dc7b, regionState=CLOSED 2023-10-01 22:02:31,486 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696197751486"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696197751486"}]},"ts":"1696197751486"} 2023-10-01 22:02:31,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 520864267e76780cb9271969eb33c9b0 2023-10-01 22:02:31,486 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=520864267e76780cb9271969eb33c9b0, regionState=CLOSED 2023-10-01 22:02:31,487 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696197751486"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696197751486"}]},"ts":"1696197751486"} 2023-10-01 22:02:31,489 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-10-01 22:02:31,489 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure aef9a4be7399e2cdc851df041217dc7b, server=jenkins-hbase4.apache.org,42263,1696197680774 in 170 msec 2023-10-01 22:02:31,490 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-10-01 22:02:31,490 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 520864267e76780cb9271969eb33c9b0, server=jenkins-hbase4.apache.org,37145,1696197680825 in 170 msec 2023-10-01 22:02:31,491 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=aef9a4be7399e2cdc851df041217dc7b, UNASSIGN in 176 msec 2023-10-01 22:02:31,492 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-10-01 22:02:31,492 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=520864267e76780cb9271969eb33c9b0, UNASSIGN in 177 msec 2023-10-01 22:02:31,492 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696197751492"}]},"ts":"1696197751492"} 2023-10-01 22:02:31,493 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-10-01 22:02:31,495 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-10-01 22:02:31,497 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 191 msec 2023-10-01 22:02:31,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-01 22:02:31,610 INFO [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-10-01 22:02:31,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-10-01 22:02:31,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-01 22:02:31,614 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-01 22:02:31,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-10-01 22:02:31,615 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-01 22:02:31,618 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37145] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-10-01 22:02:31,620 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 22:02:31,620 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 22:02:31,620 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 22:02:31,620 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 22:02:31,621 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-01 22:02:31,621 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-01 22:02:31,621 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-01 22:02:31,621 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-01 22:02:31,621 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testConsecutiveExports/aef9a4be7399e2cdc851df041217dc7b 2023-10-01 22:02:31,621 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testConsecutiveExports/520864267e76780cb9271969eb33c9b0 2023-10-01 22:02:31,623 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 22:02:31,623 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 22:02:31,623 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 22:02:31,623 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:31,623 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:31,623 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 22:02:31,623 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:31,623 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:31,623 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testConsecutiveExports/aef9a4be7399e2cdc851df041217dc7b/cf, FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testConsecutiveExports/aef9a4be7399e2cdc851df041217dc7b/recovered.edits] 2023-10-01 22:02:31,623 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testConsecutiveExports/520864267e76780cb9271969eb33c9b0/cf, FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testConsecutiveExports/520864267e76780cb9271969eb33c9b0/recovered.edits] 2023-10-01 22:02:31,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-01 22:02:31,629 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testConsecutiveExports/aef9a4be7399e2cdc851df041217dc7b/cf/d962520dde8b431aad9729ebecc922a8 to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testConsecutiveExports/aef9a4be7399e2cdc851df041217dc7b/cf/d962520dde8b431aad9729ebecc922a8 2023-10-01 22:02:31,629 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testConsecutiveExports/520864267e76780cb9271969eb33c9b0/cf/56dd2f7d87e94e93a756f70944c5ba8b to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testConsecutiveExports/520864267e76780cb9271969eb33c9b0/cf/56dd2f7d87e94e93a756f70944c5ba8b 2023-10-01 22:02:31,633 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testConsecutiveExports/aef9a4be7399e2cdc851df041217dc7b/recovered.edits/9.seqid to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testConsecutiveExports/aef9a4be7399e2cdc851df041217dc7b/recovered.edits/9.seqid 2023-10-01 22:02:31,633 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testConsecutiveExports/520864267e76780cb9271969eb33c9b0/recovered.edits/9.seqid to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testConsecutiveExports/520864267e76780cb9271969eb33c9b0/recovered.edits/9.seqid 2023-10-01 22:02:31,633 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testConsecutiveExports/aef9a4be7399e2cdc851df041217dc7b 2023-10-01 22:02:31,633 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testConsecutiveExports/520864267e76780cb9271969eb33c9b0 2023-10-01 22:02:31,634 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-01 22:02:31,634 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-01 22:02:31,635 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-10-01 22:02:31,638 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100159ca611aab934e65aaf4f467db8bb760 to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100159ca611aab934e65aaf4f467db8bb760 2023-10-01 22:02:31,639 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310018a98a81f3e7a4063b51f30914c255535 to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310018a98a81f3e7a4063b51f30914c255535 2023-10-01 22:02:31,640 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-01 22:02:31,642 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-01 22:02:31,644 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-10-01 22:02:31,646 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-10-01 22:02:31,647 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-01 22:02:31,647 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-10-01 22:02:31,647 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696197751647"}]},"ts":"9223372036854775807"} 2023-10-01 22:02:31,647 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696197751647"}]},"ts":"9223372036854775807"} 2023-10-01 22:02:31,649 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-01 22:02:31,649 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => aef9a4be7399e2cdc851df041217dc7b, NAME => 'testtb-testConsecutiveExports,,1696197721846.aef9a4be7399e2cdc851df041217dc7b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 520864267e76780cb9271969eb33c9b0, NAME => 'testtb-testConsecutiveExports,1,1696197721846.520864267e76780cb9271969eb33c9b0.', STARTKEY => '1', ENDKEY => ''}] 2023-10-01 22:02:31,649 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-10-01 22:02:31,649 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696197751649"}]},"ts":"9223372036854775807"} 2023-10-01 22:02:31,651 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-10-01 22:02:31,652 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-01 22:02:31,654 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 41 msec 2023-10-01 22:02:31,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-01 22:02:31,726 INFO [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-10-01 22:02:31,734 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-10-01 22:02:31,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-10-01 22:02:31,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-10-01 22:02:31,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testConsecutiveExports 2023-10-01 22:02:31,761 INFO [Listener at jenkins-hbase4.apache.org/45715] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=749 (was 763), OpenFileDescriptor=904 (was 935), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=204 (was 259), ProcessCount=168 (was 168), AvailableMemoryMB=1349 (was 1449) 2023-10-01 22:02:31,761 WARN [Listener at jenkins-hbase4.apache.org/45715] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-10-01 22:02:31,779 INFO [Listener at jenkins-hbase4.apache.org/45715] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=749, OpenFileDescriptor=904, MaxFileDescriptor=60000, SystemLoadAverage=204, ProcessCount=168, AvailableMemoryMB=1349 2023-10-01 22:02:31,779 WARN [Listener at jenkins-hbase4.apache.org/45715] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-10-01 22:02:31,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-01 22:02:31,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:31,784 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 22:02:31,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-10-01 22:02:31,785 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 22:02:31,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-01 22:02:31,787 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc6946692b723b511cceb3e0532a000d 2023-10-01 22:02:31,787 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f858c713b76c298ec152c5087370d038 2023-10-01 22:02:31,788 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc6946692b723b511cceb3e0532a000d empty. 2023-10-01 22:02:31,788 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f858c713b76c298ec152c5087370d038 empty. 2023-10-01 22:02:31,788 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc6946692b723b511cceb3e0532a000d 2023-10-01 22:02:31,788 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f858c713b76c298ec152c5087370d038 2023-10-01 22:02:31,788 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-01 22:02:31,799 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-10-01 22:02:31,800 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => bc6946692b723b511cceb3e0532a000d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp 2023-10-01 22:02:31,801 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => f858c713b76c298ec152c5087370d038, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp 2023-10-01 22:02:31,813 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:02:31,813 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing f858c713b76c298ec152c5087370d038, disabling compactions & flushes 2023-10-01 22:02:31,813 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038. 2023-10-01 22:02:31,814 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038. 2023-10-01 22:02:31,814 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038. after waiting 0 ms 2023-10-01 22:02:31,814 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038. 2023-10-01 22:02:31,814 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038. 2023-10-01 22:02:31,814 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for f858c713b76c298ec152c5087370d038: 2023-10-01 22:02:31,814 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:02:31,814 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing bc6946692b723b511cceb3e0532a000d, disabling compactions & flushes 2023-10-01 22:02:31,814 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d. 2023-10-01 22:02:31,814 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d. 2023-10-01 22:02:31,814 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d. after waiting 0 ms 2023-10-01 22:02:31,814 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d. 2023-10-01 22:02:31,814 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d. 2023-10-01 22:02:31,814 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for bc6946692b723b511cceb3e0532a000d: 2023-10-01 22:02:31,819 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 22:02:31,819 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696197751819"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696197751819"}]},"ts":"1696197751819"} 2023-10-01 22:02:31,820 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696197751819"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696197751819"}]},"ts":"1696197751819"} 2023-10-01 22:02:31,827 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 22:02:31,827 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 22:02:31,828 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696197751828"}]},"ts":"1696197751828"} 2023-10-01 22:02:31,829 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-10-01 22:02:31,832 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 22:02:31,833 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 22:02:31,833 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 22:02:31,833 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 22:02:31,833 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 22:02:31,834 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bc6946692b723b511cceb3e0532a000d, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f858c713b76c298ec152c5087370d038, ASSIGN}] 2023-10-01 22:02:31,836 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f858c713b76c298ec152c5087370d038, ASSIGN 2023-10-01 22:02:31,836 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bc6946692b723b511cceb3e0532a000d, ASSIGN 2023-10-01 22:02:31,839 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f858c713b76c298ec152c5087370d038, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39235,1696197680862; forceNewPlan=false, retain=false 2023-10-01 22:02:31,839 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bc6946692b723b511cceb3e0532a000d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42263,1696197680774; forceNewPlan=false, retain=false 2023-10-01 22:02:31,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-01 22:02:31,990 INFO [jenkins-hbase4:40311] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 22:02:31,992 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=bc6946692b723b511cceb3e0532a000d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:31,992 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=f858c713b76c298ec152c5087370d038, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:31,992 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696197751992"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696197751992"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696197751992"}]},"ts":"1696197751992"} 2023-10-01 22:02:31,992 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696197751992"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696197751992"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696197751992"}]},"ts":"1696197751992"} 2023-10-01 22:02:31,994 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure bc6946692b723b511cceb3e0532a000d, server=jenkins-hbase4.apache.org,42263,1696197680774}] 2023-10-01 22:02:31,995 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure f858c713b76c298ec152c5087370d038, server=jenkins-hbase4.apache.org,39235,1696197680862}] 2023-10-01 22:02:32,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-01 22:02:32,150 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038. 2023-10-01 22:02:32,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d. 2023-10-01 22:02:32,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f858c713b76c298ec152c5087370d038, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038.', STARTKEY => '1', ENDKEY => ''} 2023-10-01 22:02:32,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bc6946692b723b511cceb3e0532a000d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d.', STARTKEY => '', ENDKEY => '1'} 2023-10-01 22:02:32,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038. service=AccessControlService 2023-10-01 22:02:32,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d. service=AccessControlService 2023-10-01 22:02:32,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 22:02:32,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 22:02:32,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion f858c713b76c298ec152c5087370d038 2023-10-01 22:02:32,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion bc6946692b723b511cceb3e0532a000d 2023-10-01 22:02:32,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:02:32,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:02:32,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f858c713b76c298ec152c5087370d038 2023-10-01 22:02:32,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bc6946692b723b511cceb3e0532a000d 2023-10-01 22:02:32,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bc6946692b723b511cceb3e0532a000d 2023-10-01 22:02:32,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f858c713b76c298ec152c5087370d038 2023-10-01 22:02:32,153 INFO [StoreOpener-bc6946692b723b511cceb3e0532a000d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bc6946692b723b511cceb3e0532a000d 2023-10-01 22:02:32,153 INFO [StoreOpener-f858c713b76c298ec152c5087370d038-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f858c713b76c298ec152c5087370d038 2023-10-01 22:02:32,159 DEBUG [StoreOpener-bc6946692b723b511cceb3e0532a000d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc6946692b723b511cceb3e0532a000d/cf 2023-10-01 22:02:32,159 DEBUG [StoreOpener-f858c713b76c298ec152c5087370d038-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion/f858c713b76c298ec152c5087370d038/cf 2023-10-01 22:02:32,159 DEBUG [StoreOpener-f858c713b76c298ec152c5087370d038-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion/f858c713b76c298ec152c5087370d038/cf 2023-10-01 22:02:32,159 DEBUG [StoreOpener-bc6946692b723b511cceb3e0532a000d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc6946692b723b511cceb3e0532a000d/cf 2023-10-01 22:02:32,160 INFO [StoreOpener-bc6946692b723b511cceb3e0532a000d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bc6946692b723b511cceb3e0532a000d columnFamilyName cf 2023-10-01 22:02:32,160 INFO [StoreOpener-f858c713b76c298ec152c5087370d038-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f858c713b76c298ec152c5087370d038 columnFamilyName cf 2023-10-01 22:02:32,161 INFO [StoreOpener-bc6946692b723b511cceb3e0532a000d-1] regionserver.HStore(310): Store=bc6946692b723b511cceb3e0532a000d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 22:02:32,161 INFO [StoreOpener-f858c713b76c298ec152c5087370d038-1] regionserver.HStore(310): Store=f858c713b76c298ec152c5087370d038/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 22:02:32,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion/f858c713b76c298ec152c5087370d038 2023-10-01 22:02:32,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc6946692b723b511cceb3e0532a000d 2023-10-01 22:02:32,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion/f858c713b76c298ec152c5087370d038 2023-10-01 22:02:32,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc6946692b723b511cceb3e0532a000d 2023-10-01 22:02:32,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bc6946692b723b511cceb3e0532a000d 2023-10-01 22:02:32,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f858c713b76c298ec152c5087370d038 2023-10-01 22:02:32,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc6946692b723b511cceb3e0532a000d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 22:02:32,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion/f858c713b76c298ec152c5087370d038/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 22:02:32,168 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f858c713b76c298ec152c5087370d038; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66735446, jitterRate=-0.005564361810684204}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 22:02:32,168 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bc6946692b723b511cceb3e0532a000d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67193692, jitterRate=0.001264035701751709}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 22:02:32,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f858c713b76c298ec152c5087370d038: 2023-10-01 22:02:32,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bc6946692b723b511cceb3e0532a000d: 2023-10-01 22:02:32,169 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d., pid=60, masterSystemTime=1696197752146 2023-10-01 22:02:32,169 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038., pid=61, masterSystemTime=1696197752146 2023-10-01 22:02:32,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d. 2023-10-01 22:02:32,171 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d. 2023-10-01 22:02:32,172 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=bc6946692b723b511cceb3e0532a000d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038. 2023-10-01 22:02:32,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038. 2023-10-01 22:02:32,172 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696197752172"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696197752172"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696197752172"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696197752172"}]},"ts":"1696197752172"} 2023-10-01 22:02:32,172 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=f858c713b76c298ec152c5087370d038, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,173 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696197752172"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696197752172"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696197752172"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696197752172"}]},"ts":"1696197752172"} 2023-10-01 22:02:32,176 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=58 2023-10-01 22:02:32,176 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure bc6946692b723b511cceb3e0532a000d, server=jenkins-hbase4.apache.org,42263,1696197680774 in 180 msec 2023-10-01 22:02:32,177 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=59 2023-10-01 22:02:32,177 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure f858c713b76c298ec152c5087370d038, server=jenkins-hbase4.apache.org,39235,1696197680862 in 180 msec 2023-10-01 22:02:32,177 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bc6946692b723b511cceb3e0532a000d, ASSIGN in 342 msec 2023-10-01 22:02:32,178 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-10-01 22:02:32,178 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f858c713b76c298ec152c5087370d038, ASSIGN in 343 msec 2023-10-01 22:02:32,179 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 22:02:32,179 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696197752179"}]},"ts":"1696197752179"} 2023-10-01 22:02:32,181 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-10-01 22:02:32,184 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 22:02:32,185 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-10-01 22:02:32,187 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37145] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-01 22:02:32,188 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:32,188 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:32,188 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:32,188 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:32,190 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 22:02:32,190 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 22:02:32,190 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 22:02:32,190 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 22:02:32,191 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 409 msec 2023-10-01 22:02:32,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-01 22:02:32,388 INFO [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-10-01 22:02:32,391 DEBUG [Listener at jenkins-hbase4.apache.org/45715] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,391 DEBUG [Listener at jenkins-hbase4.apache.org/45715] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d. 2023-10-01 22:02:32,393 INFO [Listener at jenkins-hbase4.apache.org/45715] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 22:02:32,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-01 22:02:32,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696197752404 (current time:1696197752404). 2023-10-01 22:02:32,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 22:02:32,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(139): Connect 0x5a96f710 to 127.0.0.1:58905 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 22:02:32,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f10ce27, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 22:02:32,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:02:32,416 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47142, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:02:32,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a96f710 to 127.0.0.1:58905 2023-10-01 22:02:32,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:02:32,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(139): Connect 0x6dddb944 to 127.0.0.1:58905 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 22:02:32,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9efd98, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 22:02:32,424 DEBUG [hconnection-0x79867a5a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:02:32,424 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47158, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:02:32,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:02:32,430 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54216, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:02:32,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6dddb944 to 127.0.0.1:58905 2023-10-01 22:02:32,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:02:32,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-01 22:02:32,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 22:02:32,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-01 22:02:32,434 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot, current working dir path: hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 22:02:32,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-01 22:02:32,436 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-01 22:02:32,436 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696198352436 2023-10-01 22:02:32,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-01 22:02:32,437 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,438 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 22:02:32,438 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 22:02:32,439 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-01 22:02:32,439 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-01 22:02:32,440 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-10-01 22:02:32,440 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-01 22:02:32,441 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696198352441 2023-10-01 22:02:32,451 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,451 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-01 22:02:32,451 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:32,452 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-01 22:02:32,452 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-01 22:02:32,452 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,452 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,453 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:32,453 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:32,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:32,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:32,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:32,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:32,453 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:32,453 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:32,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:32,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,454 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,454 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,454 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,454 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,454 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,455 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,455 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 22:02:32,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-01 22:02:32,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-01 22:02:32,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-01 22:02:32,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,455 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-01 22:02:32,455 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-01 22:02:32,455 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-01 22:02:32,455 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,455 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,455 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-01 22:02:32,455 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-01 22:02:32,455 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:32,455 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,456 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-01 22:02:32,456 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-01 22:02:32,456 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:32,455 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:32,457 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-01 22:02:32,458 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-01 22:02:32,458 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-01 22:02:32,456 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-01 22:02:32,458 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42263,1696197680774' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-01 22:02:32,458 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39235,1696197680862' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-01 22:02:32,458 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-01 22:02:32,458 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37145,1696197680825' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-01 22:02:32,461 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,461 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:32,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:32,461 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,461 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,461 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,461 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,462 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:02:32,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:32,462 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,462 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:02:32,462 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,462 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:02:32,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:32,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:32,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:32,463 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42263,1696197680774' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-01 22:02:32,463 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@905539f[Count = 1] remaining members to acquire global barrier 2023-10-01 22:02:32,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:32,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:32,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:32,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:32,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:32,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:32,466 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39235,1696197680862' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-01 22:02:32,466 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@905539f[Count = 0] remaining members to acquire global barrier 2023-10-01 22:02:32,466 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-01 22:02:32,466 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,467 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,467 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,467 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,467 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,467 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-01 22:02:32,468 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-01 22:02:32,468 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-01 22:02:32,468 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 22:02:32,468 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 22:02:32,468 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-01 22:02:32,468 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038. 2023-10-01 22:02:32,468 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37145,1696197680825' in zk 2023-10-01 22:02:32,468 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 22:02:32,468 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,468 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d. 2023-10-01 22:02:32,468 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d. started... 2023-10-01 22:02:32,468 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 22:02:32,468 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 22:02:32,468 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038. started... 2023-10-01 22:02:32,468 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bc6946692b723b511cceb3e0532a000d: 2023-10-01 22:02:32,469 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f858c713b76c298ec152c5087370d038: 2023-10-01 22:02:32,469 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,469 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 22:02:32,469 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 22:02:32,469 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,469 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 22:02:32,469 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 22:02:32,479 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-01 22:02:32,479 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:32,479 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-01 22:02:32,485 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038. completed. 2023-10-01 22:02:32,485 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038. 2023-10-01 22:02:32,485 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 22:02:32,485 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 22:02:32,485 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,485 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-01 22:02:32,485 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39235,1696197680862' in zk 2023-10-01 22:02:32,487 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-01 22:02:32,487 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:32,487 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-01 22:02:32,487 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:32,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:32,488 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d. completed. 2023-10-01 22:02:32,488 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d. 2023-10-01 22:02:32,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:32,488 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 22:02:32,488 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 22:02:32,488 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,488 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-01 22:02:32,488 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42263,1696197680774' in zk 2023-10-01 22:02:32,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:32,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,490 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,490 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-01 22:02:32,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,490 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:32,490 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-01 22:02:32,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:32,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:32,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:32,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39235,1696197680862': 2023-10-01 22:02:32,493 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39235,1696197680862' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-01 22:02:32,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:32,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:32,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:32,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:32,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:32,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:32,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:32,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,42263,1696197680774': 2023-10-01 22:02:32,497 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42263,1696197680774' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-01 22:02:32,497 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-01 22:02:32,497 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 22:02:32,497 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 22:02:32,497 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,497 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 22:02:32,499 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,499 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,499 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:32,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:32,499 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:32,500 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:32,499 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:32,499 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:32,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:32,500 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:32,500 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:32,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:32,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:32,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:32,501 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:32,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:32,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:32,502 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:32,503 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,503 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:32,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:32,506 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:32,506 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:32,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:32,506 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:32,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:32,506 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:32,506 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,506 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:32,506 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,506 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:32,506 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:32,506 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,506 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 22:02:32,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:32,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:32,506 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:32,506 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:32,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:32,507 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:32,508 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:32,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:32,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:32,508 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,508 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-01 22:02:32,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:32,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:32,508 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:32,508 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,508 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,508 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,508 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,508 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,515 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,515 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,532 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,532 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-01 22:02:32,532 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,533 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,533 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696197752437Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696197752515 (+78 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696197752515Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696197752515Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696197752519 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696197752527 (+8 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696197752532 (+5 ms) 2023-10-01 22:02:32,534 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-01 22:02:32,536 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 98 msec 2023-10-01 22:02:32,538 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 22:02:32,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-01 22:02:32,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 22:02:32,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42263] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 22:02:32,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39235] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 22:02:32,544 DEBUG [Listener at jenkins-hbase4.apache.org/45715] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,544 DEBUG [Listener at jenkins-hbase4.apache.org/45715] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d. 2023-10-01 22:02:32,545 INFO [Listener at jenkins-hbase4.apache.org/45715] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 22:02:32,554 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-01 22:02:32,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696197752554 (current time:1696197752554). 2023-10-01 22:02:32,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 22:02:32,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(139): Connect 0x421b2d52 to 127.0.0.1:58905 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 22:02:32,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2aea7c8b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 22:02:32,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:02:32,564 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47170, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:02:32,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x421b2d52 to 127.0.0.1:58905 2023-10-01 22:02:32,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:02:32,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(139): Connect 0x6951c8de to 127.0.0.1:58905 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 22:02:32,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@723b091b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 22:02:32,573 DEBUG [hconnection-0xbcc2df3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:02:32,575 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47174, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:02:32,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:02:32,580 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54228, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:02:32,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6951c8de to 127.0.0.1:58905 2023-10-01 22:02:32,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:02:32,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-01 22:02:32,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 22:02:32,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-01 22:02:32,584 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot, current working dir path: hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 22:02:32,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-01 22:02:32,587 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-01 22:02:32,587 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696198352587 2023-10-01 22:02:32,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-01 22:02:32,587 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,588 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 22:02:32,588 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 22:02:32,589 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-01 22:02:32,589 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-01 22:02:32,590 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 4 msec 2023-10-01 22:02:32,591 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-01 22:02:32,592 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696198352592 2023-10-01 22:02:32,599 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,599 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-01 22:02:32,599 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:32,600 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-01 22:02:32,600 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-01 22:02:32,601 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,601 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,602 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:32,602 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:32,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:32,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:32,602 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:32,602 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:32,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:32,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:32,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:32,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,602 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,602 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,605 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,605 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,605 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 22:02:32,605 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,605 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-01 22:02:32,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-01 22:02:32,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-01 22:02:32,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,606 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-01 22:02:32,606 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-01 22:02:32,606 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-01 22:02:32,606 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,606 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,606 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-01 22:02:32,606 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-01 22:02:32,606 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:32,606 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:32,607 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-01 22:02:32,606 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,608 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-01 22:02:32,608 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-01 22:02:32,608 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:32,608 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-01 22:02:32,609 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-01 22:02:32,609 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-01 22:02:32,609 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42263,1696197680774' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-01 22:02:32,609 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39235,1696197680862' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-01 22:02:32,608 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-01 22:02:32,609 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37145,1696197680825' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-01 22:02:32,610 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,610 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,610 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,610 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:32,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:32,610 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,611 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,611 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:02:32,611 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,611 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:02:32,611 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:32,611 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:02:32,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:32,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:32,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:32,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39235,1696197680862' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-01 22:02:32,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5aa971ca[Count = 1] remaining members to acquire global barrier 2023-10-01 22:02:32,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:32,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:32,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:32,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:32,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:32,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:32,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42263,1696197680774' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-01 22:02:32,615 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5aa971ca[Count = 0] remaining members to acquire global barrier 2023-10-01 22:02:32,615 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-01 22:02:32,615 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,617 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,617 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,617 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,617 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-01 22:02:32,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,617 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,617 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 22:02:32,617 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 22:02:32,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,617 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038. 2023-10-01 22:02:32,617 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-01 22:02:32,617 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038. started... 2023-10-01 22:02:32,617 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,617 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 22:02:32,617 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-01 22:02:32,617 INFO [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f858c713b76c298ec152c5087370d038 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-10-01 22:02:32,617 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-01 22:02:32,617 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37145,1696197680825' in zk 2023-10-01 22:02:32,618 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 22:02:32,618 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d. 2023-10-01 22:02:32,618 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 22:02:32,618 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d. started... 2023-10-01 22:02:32,618 INFO [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HRegion(2745): Flushing bc6946692b723b511cceb3e0532a000d 1/1 column families, dataSize=333 B heapSize=976 B 2023-10-01 22:02:32,619 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-01 22:02:32,619 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:32,619 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-01 22:02:32,636 INFO [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310012f8bbd8923fd4e6886e29df6112fbe86 to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310012f8bbd8923fd4e6886e29df6112fbe86 2023-10-01 22:02:32,637 INFO [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023100198b66943328f4472aeed7f75faa0d8d8 to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023100198b66943328f4472aeed7f75faa0d8d8 2023-10-01 22:02:32,642 INFO [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc6946692b723b511cceb3e0532a000d/.tmp/cf/eebfc17fe3e441f38ee0cdcd4e298a5f 2023-10-01 22:02:32,644 INFO [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion/f858c713b76c298ec152c5087370d038/.tmp/cf/43346e94f76c42fa8c20b55016893ef2 2023-10-01 22:02:32,647 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc6946692b723b511cceb3e0532a000d/.tmp/cf/eebfc17fe3e441f38ee0cdcd4e298a5f as hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc6946692b723b511cceb3e0532a000d/cf/eebfc17fe3e441f38ee0cdcd4e298a5f 2023-10-01 22:02:32,649 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion/f858c713b76c298ec152c5087370d038/.tmp/cf/43346e94f76c42fa8c20b55016893ef2 as hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion/f858c713b76c298ec152c5087370d038/cf/43346e94f76c42fa8c20b55016893ef2 2023-10-01 22:02:32,652 INFO [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc6946692b723b511cceb3e0532a000d/cf/eebfc17fe3e441f38ee0cdcd4e298a5f, entries=5, sequenceid=6, filesize=5.8 K 2023-10-01 22:02:32,653 INFO [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for bc6946692b723b511cceb3e0532a000d in 35ms, sequenceid=6, compaction requested=false 2023-10-01 22:02:32,653 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-10-01 22:02:32,653 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bc6946692b723b511cceb3e0532a000d: 2023-10-01 22:02:32,653 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,653 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 22:02:32,653 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc6946692b723b511cceb3e0532a000d/cf/eebfc17fe3e441f38ee0cdcd4e298a5f] hfiles 2023-10-01 22:02:32,653 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc6946692b723b511cceb3e0532a000d/cf/eebfc17fe3e441f38ee0cdcd4e298a5f for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,654 INFO [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion/f858c713b76c298ec152c5087370d038/cf/43346e94f76c42fa8c20b55016893ef2, entries=45, sequenceid=6, filesize=13.2 K 2023-10-01 22:02:32,654 INFO [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for f858c713b76c298ec152c5087370d038 in 37ms, sequenceid=6, compaction requested=false 2023-10-01 22:02:32,656 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f858c713b76c298ec152c5087370d038: 2023-10-01 22:02:32,656 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,656 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 22:02:32,656 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion/f858c713b76c298ec152c5087370d038/cf/43346e94f76c42fa8c20b55016893ef2] hfiles 2023-10-01 22:02:32,656 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion/f858c713b76c298ec152c5087370d038/cf/43346e94f76c42fa8c20b55016893ef2 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,662 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d. completed. 2023-10-01 22:02:32,662 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d. 2023-10-01 22:02:32,662 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 22:02:32,663 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 22:02:32,663 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,663 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-01 22:02:32,663 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42263,1696197680774' in zk 2023-10-01 22:02:32,663 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038. completed. 2023-10-01 22:02:32,664 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038. 2023-10-01 22:02:32,664 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 22:02:32,664 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 22:02:32,664 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,664 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-01 22:02:32,664 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39235,1696197680862' in zk 2023-10-01 22:02:32,664 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-01 22:02:32,664 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,664 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:32,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:32,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:32,665 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-01 22:02:32,667 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,667 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-01 22:02:32,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:32,667 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:32,667 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-01 22:02:32,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:32,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:32,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:32,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:32,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,42263,1696197680774': 2023-10-01 22:02:32,671 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42263,1696197680774' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-01 22:02:32,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:32,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:32,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:32,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:32,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:32,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:32,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:32,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39235,1696197680862': 2023-10-01 22:02:32,674 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39235,1696197680862' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-01 22:02:32,674 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-01 22:02:32,674 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 22:02:32,674 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 22:02:32,674 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,674 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 22:02:32,679 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,679 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,679 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:32,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:32,679 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,679 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:32,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,679 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:32,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,680 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,679 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:32,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:32,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:32,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:32,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:32,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:32,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:32,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:32,680 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,681 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:32,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:32,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:32,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:32,682 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,682 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,683 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:32,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:32,686 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:32,686 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,686 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:32,686 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:32,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:32,686 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:32,686 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:32,686 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,686 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:32,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:32,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:32,686 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:32,686 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:32,687 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:32,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:32,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:32,687 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:32,687 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,687 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:32,688 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 22:02:32,687 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,688 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:32,688 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,688 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:32,688 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:32,688 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,688 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,688 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 22:02:32,689 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023100198b66943328f4472aeed7f75faa0d8d8, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310012f8bbd8923fd4e6886e29df6112fbe86] mob files 2023-10-01 22:02:32,689 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023100198b66943328f4472aeed7f75faa0d8d8 2023-10-01 22:02:32,689 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310012f8bbd8923fd4e6886e29df6112fbe86 2023-10-01 22:02:32,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-01 22:02:32,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-01 22:02:32,690 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 22:02:32,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:32,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:32,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:32,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:32,695 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,712 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,712 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-01 22:02:32,712 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,713 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:32,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696197752587Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696197752695 (+108 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696197752695Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1696197752696 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1696197752699 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696197752706 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696197752712 (+6 ms) 2023-10-01 22:02:32,715 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-01 22:02:32,716 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 127 msec 2023-10-01 22:02:32,890 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 22:02:32,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-01 22:02:32,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 22:02:32,918 DEBUG [Listener at jenkins-hbase4.apache.org/45715] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-01 22:02:32,921 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54230, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-01 22:02:32,923 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37145] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-01 22:02:32,923 DEBUG [Listener at jenkins-hbase4.apache.org/45715] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-01 22:02:32,926 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56374, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-01 22:02:32,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39235] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-01 22:02:32,926 DEBUG [Listener at jenkins-hbase4.apache.org/45715] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-01 22:02:32,929 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47188, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-01 22:02:32,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42263] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-01 22:02:32,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-01 22:02:32,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:32,933 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 22:02:32,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-10-01 22:02:32,934 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 22:02:32,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-01 22:02:32,937 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63a89fe5298deff6125bc77e6a62cb8e 2023-10-01 22:02:32,937 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/510042633b7ccf8290114fe1a94ea346 2023-10-01 22:02:32,937 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63a89fe5298deff6125bc77e6a62cb8e empty. 2023-10-01 22:02:32,937 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/510042633b7ccf8290114fe1a94ea346 empty. 2023-10-01 22:02:32,938 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63a89fe5298deff6125bc77e6a62cb8e 2023-10-01 22:02:32,938 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/510042633b7ccf8290114fe1a94ea346 2023-10-01 22:02:32,938 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-01 22:02:32,947 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-10-01 22:02:32,948 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 63a89fe5298deff6125bc77e6a62cb8e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752930.63a89fe5298deff6125bc77e6a62cb8e.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp 2023-10-01 22:02:32,948 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 510042633b7ccf8290114fe1a94ea346, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696197752930.510042633b7ccf8290114fe1a94ea346.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp 2023-10-01 22:02:32,956 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752930.63a89fe5298deff6125bc77e6a62cb8e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:02:32,956 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 63a89fe5298deff6125bc77e6a62cb8e, disabling compactions & flushes 2023-10-01 22:02:32,957 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752930.63a89fe5298deff6125bc77e6a62cb8e. 2023-10-01 22:02:32,957 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752930.63a89fe5298deff6125bc77e6a62cb8e. 2023-10-01 22:02:32,957 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696197752930.510042633b7ccf8290114fe1a94ea346.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:02:32,957 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752930.63a89fe5298deff6125bc77e6a62cb8e. after waiting 0 ms 2023-10-01 22:02:32,957 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752930.63a89fe5298deff6125bc77e6a62cb8e. 2023-10-01 22:02:32,957 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 510042633b7ccf8290114fe1a94ea346, disabling compactions & flushes 2023-10-01 22:02:32,957 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752930.63a89fe5298deff6125bc77e6a62cb8e. 2023-10-01 22:02:32,957 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696197752930.510042633b7ccf8290114fe1a94ea346. 2023-10-01 22:02:32,957 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 63a89fe5298deff6125bc77e6a62cb8e: 2023-10-01 22:02:32,957 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696197752930.510042633b7ccf8290114fe1a94ea346. 2023-10-01 22:02:32,957 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696197752930.510042633b7ccf8290114fe1a94ea346. after waiting 0 ms 2023-10-01 22:02:32,957 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696197752930.510042633b7ccf8290114fe1a94ea346. 2023-10-01 22:02:32,957 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696197752930.510042633b7ccf8290114fe1a94ea346. 2023-10-01 22:02:32,957 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 510042633b7ccf8290114fe1a94ea346: 2023-10-01 22:02:32,959 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 22:02:32,960 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752930.63a89fe5298deff6125bc77e6a62cb8e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696197752960"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696197752960"}]},"ts":"1696197752960"} 2023-10-01 22:02:32,960 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696197752930.510042633b7ccf8290114fe1a94ea346.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696197752960"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696197752960"}]},"ts":"1696197752960"} 2023-10-01 22:02:32,962 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 22:02:32,963 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 22:02:32,963 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696197752963"}]},"ts":"1696197752963"} 2023-10-01 22:02:32,964 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-10-01 22:02:32,967 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 22:02:32,968 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 22:02:32,968 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 22:02:32,968 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 22:02:32,968 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 22:02:32,968 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=63a89fe5298deff6125bc77e6a62cb8e, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=510042633b7ccf8290114fe1a94ea346, ASSIGN}] 2023-10-01 22:02:32,971 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=510042633b7ccf8290114fe1a94ea346, ASSIGN 2023-10-01 22:02:32,971 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=63a89fe5298deff6125bc77e6a62cb8e, ASSIGN 2023-10-01 22:02:32,972 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=510042633b7ccf8290114fe1a94ea346, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42263,1696197680774; forceNewPlan=false, retain=false 2023-10-01 22:02:32,972 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=63a89fe5298deff6125bc77e6a62cb8e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39235,1696197680862; forceNewPlan=false, retain=false 2023-10-01 22:02:33,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-01 22:02:33,122 INFO [jenkins-hbase4:40311] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 22:02:33,125 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=63a89fe5298deff6125bc77e6a62cb8e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:33,125 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=510042633b7ccf8290114fe1a94ea346, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:33,125 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752930.63a89fe5298deff6125bc77e6a62cb8e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696197753125"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696197753125"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696197753125"}]},"ts":"1696197753125"} 2023-10-01 22:02:33,125 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696197752930.510042633b7ccf8290114fe1a94ea346.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696197753125"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696197753125"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696197753125"}]},"ts":"1696197753125"} 2023-10-01 22:02:33,127 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 63a89fe5298deff6125bc77e6a62cb8e, server=jenkins-hbase4.apache.org,39235,1696197680862}] 2023-10-01 22:02:33,128 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 510042633b7ccf8290114fe1a94ea346, server=jenkins-hbase4.apache.org,42263,1696197680774}] 2023-10-01 22:02:33,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-01 22:02:33,282 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752930.63a89fe5298deff6125bc77e6a62cb8e. 2023-10-01 22:02:33,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 63a89fe5298deff6125bc77e6a62cb8e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752930.63a89fe5298deff6125bc77e6a62cb8e.', STARTKEY => '', ENDKEY => '2'} 2023-10-01 22:02:33,282 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1696197752930.510042633b7ccf8290114fe1a94ea346. 2023-10-01 22:02:33,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 510042633b7ccf8290114fe1a94ea346, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696197752930.510042633b7ccf8290114fe1a94ea346.', STARTKEY => '2', ENDKEY => ''} 2023-10-01 22:02:33,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752930.63a89fe5298deff6125bc77e6a62cb8e. service=AccessControlService 2023-10-01 22:02:33,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1696197752930.510042633b7ccf8290114fe1a94ea346. service=AccessControlService 2023-10-01 22:02:33,283 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 22:02:33,283 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 22:02:33,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 63a89fe5298deff6125bc77e6a62cb8e 2023-10-01 22:02:33,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 510042633b7ccf8290114fe1a94ea346 2023-10-01 22:02:33,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752930.63a89fe5298deff6125bc77e6a62cb8e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:02:33,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696197752930.510042633b7ccf8290114fe1a94ea346.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:02:33,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 63a89fe5298deff6125bc77e6a62cb8e 2023-10-01 22:02:33,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 510042633b7ccf8290114fe1a94ea346 2023-10-01 22:02:33,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 510042633b7ccf8290114fe1a94ea346 2023-10-01 22:02:33,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 63a89fe5298deff6125bc77e6a62cb8e 2023-10-01 22:02:33,285 INFO [StoreOpener-63a89fe5298deff6125bc77e6a62cb8e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 63a89fe5298deff6125bc77e6a62cb8e 2023-10-01 22:02:33,285 INFO [StoreOpener-510042633b7ccf8290114fe1a94ea346-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 510042633b7ccf8290114fe1a94ea346 2023-10-01 22:02:33,286 DEBUG [StoreOpener-63a89fe5298deff6125bc77e6a62cb8e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63a89fe5298deff6125bc77e6a62cb8e/cf 2023-10-01 22:02:33,286 DEBUG [StoreOpener-63a89fe5298deff6125bc77e6a62cb8e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63a89fe5298deff6125bc77e6a62cb8e/cf 2023-10-01 22:02:33,286 DEBUG [StoreOpener-510042633b7ccf8290114fe1a94ea346-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/510042633b7ccf8290114fe1a94ea346/cf 2023-10-01 22:02:33,286 DEBUG [StoreOpener-510042633b7ccf8290114fe1a94ea346-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/510042633b7ccf8290114fe1a94ea346/cf 2023-10-01 22:02:33,287 INFO [StoreOpener-63a89fe5298deff6125bc77e6a62cb8e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 63a89fe5298deff6125bc77e6a62cb8e columnFamilyName cf 2023-10-01 22:02:33,287 INFO [StoreOpener-510042633b7ccf8290114fe1a94ea346-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 510042633b7ccf8290114fe1a94ea346 columnFamilyName cf 2023-10-01 22:02:33,287 INFO [StoreOpener-63a89fe5298deff6125bc77e6a62cb8e-1] regionserver.HStore(310): Store=63a89fe5298deff6125bc77e6a62cb8e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 22:02:33,287 INFO [StoreOpener-510042633b7ccf8290114fe1a94ea346-1] regionserver.HStore(310): Store=510042633b7ccf8290114fe1a94ea346/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 22:02:33,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63a89fe5298deff6125bc77e6a62cb8e 2023-10-01 22:02:33,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/510042633b7ccf8290114fe1a94ea346 2023-10-01 22:02:33,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63a89fe5298deff6125bc77e6a62cb8e 2023-10-01 22:02:33,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/510042633b7ccf8290114fe1a94ea346 2023-10-01 22:02:33,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 510042633b7ccf8290114fe1a94ea346 2023-10-01 22:02:33,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 63a89fe5298deff6125bc77e6a62cb8e 2023-10-01 22:02:33,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/510042633b7ccf8290114fe1a94ea346/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 22:02:33,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63a89fe5298deff6125bc77e6a62cb8e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 22:02:33,294 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 510042633b7ccf8290114fe1a94ea346; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58986014, jitterRate=-0.12103989720344543}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 22:02:33,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 510042633b7ccf8290114fe1a94ea346: 2023-10-01 22:02:33,294 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 63a89fe5298deff6125bc77e6a62cb8e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58720993, jitterRate=-0.12498901784420013}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 22:02:33,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 63a89fe5298deff6125bc77e6a62cb8e: 2023-10-01 22:02:33,294 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696197752930.510042633b7ccf8290114fe1a94ea346., pid=70, masterSystemTime=1696197753279 2023-10-01 22:02:33,294 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752930.63a89fe5298deff6125bc77e6a62cb8e., pid=69, masterSystemTime=1696197753278 2023-10-01 22:02:33,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752930.63a89fe5298deff6125bc77e6a62cb8e. 2023-10-01 22:02:33,296 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752930.63a89fe5298deff6125bc77e6a62cb8e. 2023-10-01 22:02:33,297 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=63a89fe5298deff6125bc77e6a62cb8e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:33,297 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752930.63a89fe5298deff6125bc77e6a62cb8e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696197753296"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696197753296"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696197753296"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696197753296"}]},"ts":"1696197753296"} 2023-10-01 22:02:33,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696197752930.510042633b7ccf8290114fe1a94ea346. 2023-10-01 22:02:33,297 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1696197752930.510042633b7ccf8290114fe1a94ea346. 2023-10-01 22:02:33,297 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=510042633b7ccf8290114fe1a94ea346, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:33,297 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696197752930.510042633b7ccf8290114fe1a94ea346.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696197753297"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696197753297"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696197753297"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696197753297"}]},"ts":"1696197753297"} 2023-10-01 22:02:33,300 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-10-01 22:02:33,300 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 63a89fe5298deff6125bc77e6a62cb8e, server=jenkins-hbase4.apache.org,39235,1696197680862 in 171 msec 2023-10-01 22:02:33,302 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=63a89fe5298deff6125bc77e6a62cb8e, ASSIGN in 332 msec 2023-10-01 22:02:33,302 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-10-01 22:02:33,303 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 510042633b7ccf8290114fe1a94ea346, server=jenkins-hbase4.apache.org,42263,1696197680774 in 173 msec 2023-10-01 22:02:33,304 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=66 2023-10-01 22:02:33,304 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=510042633b7ccf8290114fe1a94ea346, ASSIGN in 335 msec 2023-10-01 22:02:33,305 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 22:02:33,305 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696197753305"}]},"ts":"1696197753305"} 2023-10-01 22:02:33,306 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-10-01 22:02:33,309 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 22:02:33,310 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-10-01 22:02:33,311 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37145] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-01 22:02:33,313 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:33,313 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:33,313 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:33,313 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:33,314 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 22:02:33,314 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 22:02:33,314 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 22:02:33,315 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-01 22:02:33,315 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-01 22:02:33,315 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-01 22:02:33,315 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 22:02:33,315 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-01 22:02:33,316 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 383 msec 2023-10-01 22:02:33,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-01 22:02:33,538 INFO [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-10-01 22:02:33,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 63a89fe5298deff6125bc77e6a62cb8e, 510042633b7ccf8290114fe1a94ea346 2023-10-01 22:02:33,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[63a89fe5298deff6125bc77e6a62cb8e, 510042633b7ccf8290114fe1a94ea346], force=true 2023-10-01 22:02:33,568 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[63a89fe5298deff6125bc77e6a62cb8e, 510042633b7ccf8290114fe1a94ea346], force=true 2023-10-01 22:02:33,568 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[63a89fe5298deff6125bc77e6a62cb8e, 510042633b7ccf8290114fe1a94ea346], force=true 2023-10-01 22:02:33,568 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[63a89fe5298deff6125bc77e6a62cb8e, 510042633b7ccf8290114fe1a94ea346], force=true 2023-10-01 22:02:33,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-01 22:02:33,589 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=63a89fe5298deff6125bc77e6a62cb8e, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=510042633b7ccf8290114fe1a94ea346, UNASSIGN}] 2023-10-01 22:02:33,591 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=63a89fe5298deff6125bc77e6a62cb8e, UNASSIGN 2023-10-01 22:02:33,591 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=510042633b7ccf8290114fe1a94ea346, UNASSIGN 2023-10-01 22:02:33,592 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=510042633b7ccf8290114fe1a94ea346, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:33,592 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=63a89fe5298deff6125bc77e6a62cb8e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:33,592 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696197752930.510042633b7ccf8290114fe1a94ea346.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696197753592"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696197753592"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696197753592"}]},"ts":"1696197753592"} 2023-10-01 22:02:33,592 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752930.63a89fe5298deff6125bc77e6a62cb8e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696197753592"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696197753592"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696197753592"}]},"ts":"1696197753592"} 2023-10-01 22:02:33,594 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 510042633b7ccf8290114fe1a94ea346, server=jenkins-hbase4.apache.org,42263,1696197680774}] 2023-10-01 22:02:33,594 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 63a89fe5298deff6125bc77e6a62cb8e, server=jenkins-hbase4.apache.org,39235,1696197680862}] 2023-10-01 22:02:33,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-01 22:02:33,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 510042633b7ccf8290114fe1a94ea346 2023-10-01 22:02:33,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 510042633b7ccf8290114fe1a94ea346, disabling compactions & flushes 2023-10-01 22:02:33,747 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696197752930.510042633b7ccf8290114fe1a94ea346. 2023-10-01 22:02:33,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696197752930.510042633b7ccf8290114fe1a94ea346. 2023-10-01 22:02:33,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696197752930.510042633b7ccf8290114fe1a94ea346. after waiting 0 ms 2023-10-01 22:02:33,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696197752930.510042633b7ccf8290114fe1a94ea346. 2023-10-01 22:02:33,748 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 510042633b7ccf8290114fe1a94ea346 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-01 22:02:33,748 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 63a89fe5298deff6125bc77e6a62cb8e 2023-10-01 22:02:33,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 63a89fe5298deff6125bc77e6a62cb8e, disabling compactions & flushes 2023-10-01 22:02:33,749 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752930.63a89fe5298deff6125bc77e6a62cb8e. 2023-10-01 22:02:33,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752930.63a89fe5298deff6125bc77e6a62cb8e. 2023-10-01 22:02:33,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752930.63a89fe5298deff6125bc77e6a62cb8e. after waiting 0 ms 2023-10-01 22:02:33,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752930.63a89fe5298deff6125bc77e6a62cb8e. 2023-10-01 22:02:33,749 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 63a89fe5298deff6125bc77e6a62cb8e 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-01 22:02:33,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/510042633b7ccf8290114fe1a94ea346/.tmp/cf/46d0a92230e544468707ab961059e7d2 2023-10-01 22:02:33,765 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63a89fe5298deff6125bc77e6a62cb8e/.tmp/cf/abe04ef65c404865bc4eb79f2b80db95 2023-10-01 22:02:33,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/510042633b7ccf8290114fe1a94ea346/.tmp/cf/46d0a92230e544468707ab961059e7d2 as hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/510042633b7ccf8290114fe1a94ea346/cf/46d0a92230e544468707ab961059e7d2 2023-10-01 22:02:33,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63a89fe5298deff6125bc77e6a62cb8e/.tmp/cf/abe04ef65c404865bc4eb79f2b80db95 as hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63a89fe5298deff6125bc77e6a62cb8e/cf/abe04ef65c404865bc4eb79f2b80db95 2023-10-01 22:02:33,775 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/510042633b7ccf8290114fe1a94ea346/cf/46d0a92230e544468707ab961059e7d2, entries=1, sequenceid=5, filesize=4.7 K 2023-10-01 22:02:33,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 510042633b7ccf8290114fe1a94ea346 in 28ms, sequenceid=5, compaction requested=false 2023-10-01 22:02:33,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-10-01 22:02:33,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63a89fe5298deff6125bc77e6a62cb8e/cf/abe04ef65c404865bc4eb79f2b80db95, entries=1, sequenceid=5, filesize=4.7 K 2023-10-01 22:02:33,780 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 63a89fe5298deff6125bc77e6a62cb8e in 31ms, sequenceid=5, compaction requested=false 2023-10-01 22:02:33,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/510042633b7ccf8290114fe1a94ea346/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-01 22:02:33,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 22:02:33,785 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696197752930.510042633b7ccf8290114fe1a94ea346. 2023-10-01 22:02:33,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 510042633b7ccf8290114fe1a94ea346: 2023-10-01 22:02:33,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63a89fe5298deff6125bc77e6a62cb8e/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-01 22:02:33,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 22:02:33,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752930.63a89fe5298deff6125bc77e6a62cb8e. 2023-10-01 22:02:33,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 63a89fe5298deff6125bc77e6a62cb8e: 2023-10-01 22:02:33,787 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 510042633b7ccf8290114fe1a94ea346 2023-10-01 22:02:33,787 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=510042633b7ccf8290114fe1a94ea346, regionState=CLOSED 2023-10-01 22:02:33,787 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696197752930.510042633b7ccf8290114fe1a94ea346.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696197753787"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696197753787"}]},"ts":"1696197753787"} 2023-10-01 22:02:33,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 63a89fe5298deff6125bc77e6a62cb8e 2023-10-01 22:02:33,788 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=63a89fe5298deff6125bc77e6a62cb8e, regionState=CLOSED 2023-10-01 22:02:33,788 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752930.63a89fe5298deff6125bc77e6a62cb8e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696197753788"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696197753788"}]},"ts":"1696197753788"} 2023-10-01 22:02:33,790 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=73 2023-10-01 22:02:33,790 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 510042633b7ccf8290114fe1a94ea346, server=jenkins-hbase4.apache.org,42263,1696197680774 in 196 msec 2023-10-01 22:02:33,791 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=72 2023-10-01 22:02:33,791 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 63a89fe5298deff6125bc77e6a62cb8e, server=jenkins-hbase4.apache.org,39235,1696197680862 in 196 msec 2023-10-01 22:02:33,792 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=510042633b7ccf8290114fe1a94ea346, UNASSIGN in 201 msec 2023-10-01 22:02:33,793 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-10-01 22:02:33,793 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=63a89fe5298deff6125bc77e6a62cb8e, UNASSIGN in 205 msec 2023-10-01 22:02:33,838 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9682b073ddd338bc11e5321fab7a4eaa/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-10-01 22:02:33,840 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752930.63a89fe5298deff6125bc77e6a62cb8e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-01 22:02:33,840 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696197752930.510042633b7ccf8290114fe1a94ea346.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-01 22:02:33,840 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752931.9682b073ddd338bc11e5321fab7a4eaa.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-01 22:02:33,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-01 22:02:33,888 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9682b073ddd338bc11e5321fab7a4eaa, ASSIGN}] 2023-10-01 22:02:33,889 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9682b073ddd338bc11e5321fab7a4eaa, ASSIGN 2023-10-01 22:02:33,890 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9682b073ddd338bc11e5321fab7a4eaa, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,39235,1696197680862; forceNewPlan=false, retain=false 2023-10-01 22:02:34,040 INFO [jenkins-hbase4:40311] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-01 22:02:34,042 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=9682b073ddd338bc11e5321fab7a4eaa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:34,042 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752931.9682b073ddd338bc11e5321fab7a4eaa.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696197754042"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696197754042"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696197754042"}]},"ts":"1696197754042"} 2023-10-01 22:02:34,044 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 9682b073ddd338bc11e5321fab7a4eaa, server=jenkins-hbase4.apache.org,39235,1696197680862}] 2023-10-01 22:02:34,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-01 22:02:34,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752931.9682b073ddd338bc11e5321fab7a4eaa. 2023-10-01 22:02:34,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9682b073ddd338bc11e5321fab7a4eaa, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752931.9682b073ddd338bc11e5321fab7a4eaa.', STARTKEY => '', ENDKEY => ''} 2023-10-01 22:02:34,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752931.9682b073ddd338bc11e5321fab7a4eaa. service=AccessControlService 2023-10-01 22:02:34,199 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 22:02:34,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 9682b073ddd338bc11e5321fab7a4eaa 2023-10-01 22:02:34,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752931.9682b073ddd338bc11e5321fab7a4eaa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:02:34,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9682b073ddd338bc11e5321fab7a4eaa 2023-10-01 22:02:34,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9682b073ddd338bc11e5321fab7a4eaa 2023-10-01 22:02:34,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9682b073ddd338bc11e5321fab7a4eaa/.regioninfo 2023-10-01 22:02:34,208 INFO [StoreOpener-9682b073ddd338bc11e5321fab7a4eaa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9682b073ddd338bc11e5321fab7a4eaa 2023-10-01 22:02:34,209 DEBUG [StoreOpener-9682b073ddd338bc11e5321fab7a4eaa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9682b073ddd338bc11e5321fab7a4eaa/cf 2023-10-01 22:02:34,209 DEBUG [StoreOpener-9682b073ddd338bc11e5321fab7a4eaa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9682b073ddd338bc11e5321fab7a4eaa/cf 2023-10-01 22:02:34,209 INFO [StoreOpener-9682b073ddd338bc11e5321fab7a4eaa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9682b073ddd338bc11e5321fab7a4eaa columnFamilyName cf 2023-10-01 22:02:34,236 DEBUG [StoreOpener-9682b073ddd338bc11e5321fab7a4eaa-1] regionserver.HStore(539): loaded hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9682b073ddd338bc11e5321fab7a4eaa/cf/46d0a92230e544468707ab961059e7d2.510042633b7ccf8290114fe1a94ea346->hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/510042633b7ccf8290114fe1a94ea346/cf/46d0a92230e544468707ab961059e7d2-top 2023-10-01 22:02:34,241 DEBUG [StoreOpener-9682b073ddd338bc11e5321fab7a4eaa-1] regionserver.HStore(539): loaded hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9682b073ddd338bc11e5321fab7a4eaa/cf/abe04ef65c404865bc4eb79f2b80db95.63a89fe5298deff6125bc77e6a62cb8e->hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63a89fe5298deff6125bc77e6a62cb8e/cf/abe04ef65c404865bc4eb79f2b80db95-top 2023-10-01 22:02:34,242 INFO [StoreOpener-9682b073ddd338bc11e5321fab7a4eaa-1] regionserver.HStore(310): Store=9682b073ddd338bc11e5321fab7a4eaa/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 22:02:34,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9682b073ddd338bc11e5321fab7a4eaa 2023-10-01 22:02:34,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9682b073ddd338bc11e5321fab7a4eaa 2023-10-01 22:02:34,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9682b073ddd338bc11e5321fab7a4eaa 2023-10-01 22:02:34,247 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9682b073ddd338bc11e5321fab7a4eaa; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67560492, jitterRate=0.006729781627655029}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 22:02:34,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9682b073ddd338bc11e5321fab7a4eaa: 2023-10-01 22:02:34,248 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752931.9682b073ddd338bc11e5321fab7a4eaa., pid=77, masterSystemTime=1696197754195 2023-10-01 22:02:34,248 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752931.9682b073ddd338bc11e5321fab7a4eaa.,because compaction is disabled. 2023-10-01 22:02:34,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752931.9682b073ddd338bc11e5321fab7a4eaa. 2023-10-01 22:02:34,250 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752931.9682b073ddd338bc11e5321fab7a4eaa. 2023-10-01 22:02:34,250 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=9682b073ddd338bc11e5321fab7a4eaa, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:34,250 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752931.9682b073ddd338bc11e5321fab7a4eaa.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696197754250"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696197754250"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696197754250"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696197754250"}]},"ts":"1696197754250"} 2023-10-01 22:02:34,253 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-10-01 22:02:34,253 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 9682b073ddd338bc11e5321fab7a4eaa, server=jenkins-hbase4.apache.org,39235,1696197680862 in 208 msec 2023-10-01 22:02:34,254 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-10-01 22:02:34,254 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9682b073ddd338bc11e5321fab7a4eaa, ASSIGN in 365 msec 2023-10-01 22:02:34,256 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[63a89fe5298deff6125bc77e6a62cb8e, 510042633b7ccf8290114fe1a94ea346], force=true in 694 msec 2023-10-01 22:02:34,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-01 22:02:34,675 INFO [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-10-01 22:02:34,676 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-01 22:02:34,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696197754676 (current time:1696197754676). 2023-10-01 22:02:34,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 22:02:34,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(139): Connect 0x4cf6b4ff to 127.0.0.1:58905 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 22:02:34,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@562af8f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 22:02:34,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:02:34,687 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47194, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:02:34,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4cf6b4ff to 127.0.0.1:58905 2023-10-01 22:02:34,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:02:34,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(139): Connect 0x33bd0299 to 127.0.0.1:58905 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 22:02:34,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a95195d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 22:02:34,695 DEBUG [hconnection-0x5a1bd957-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:02:34,697 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47204, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:02:34,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:02:34,703 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54234, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:02:34,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33bd0299 to 127.0.0.1:58905 2023-10-01 22:02:34,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:02:34,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-01 22:02:34,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 22:02:34,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-01 22:02:34,707 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot, current working dir path: hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 22:02:34,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-01 22:02:34,709 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-01 22:02:34,710 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1696198354710 2023-10-01 22:02:34,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-01 22:02:34,710 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,713 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 22:02:34,713 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 22:02:34,714 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-01 22:02:34,714 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-01 22:02:34,715 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 6 msec 2023-10-01 22:02:34,716 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-01 22:02:34,716 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1696198354716 2023-10-01 22:02:34,724 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,724 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-10-01 22:02:34,724 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:34,725 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-10-01 22:02:34,725 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-10-01 22:02:34,726 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,726 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,727 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:34,727 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:34,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:34,727 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:34,727 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:34,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:34,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:34,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:34,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:34,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:34,727 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:34,727 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 22:02:34,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,728 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,728 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,728 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-01 22:02:34,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-01 22:02:34,728 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-01 22:02:34,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-01 22:02:34,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,729 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,729 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-01 22:02:34,729 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-01 22:02:34,729 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-01 22:02:34,729 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:34,729 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,730 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-01 22:02:34,730 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-01 22:02:34,730 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:34,730 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-01 22:02:34,730 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42263,1696197680774' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-01 22:02:34,730 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,731 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-01 22:02:34,731 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-01 22:02:34,731 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-01 22:02:34,731 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:34,731 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37145,1696197680825' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-01 22:02:34,732 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,732 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-01 22:02:34,732 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-01 22:02:34,732 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39235,1696197680862' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-01 22:02:34,733 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,733 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:02:34,733 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,735 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:34,735 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,735 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,735 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:02:34,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:34,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:34,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:34,736 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,736 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:02:34,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:34,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:34,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:34,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:34,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:34,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:34,738 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39235,1696197680862' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-10-01 22:02:34,738 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9df8878[Count = 0] remaining members to acquire global barrier 2023-10-01 22:02:34,738 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-10-01 22:02:34,738 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,739 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,739 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,739 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,739 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-01 22:02:34,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,739 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:34,739 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 22:02:34,740 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 22:02:34,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,740 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752931.9682b073ddd338bc11e5321fab7a4eaa. 2023-10-01 22:02:34,740 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-01 22:02:34,740 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752931.9682b073ddd338bc11e5321fab7a4eaa. started... 2023-10-01 22:02:34,739 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 22:02:34,739 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-01 22:02:34,740 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-01 22:02:34,741 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9682b073ddd338bc11e5321fab7a4eaa: 2023-10-01 22:02:34,741 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-01 22:02:34,741 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,42263,1696197680774' in zk 2023-10-01 22:02:34,741 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,37145,1696197680825' in zk 2023-10-01 22:02:34,741 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752931.9682b073ddd338bc11e5321fab7a4eaa.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,741 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 22:02:34,741 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9682b073ddd338bc11e5321fab7a4eaa/cf/46d0a92230e544468707ab961059e7d2.510042633b7ccf8290114fe1a94ea346->hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/510042633b7ccf8290114fe1a94ea346/cf/46d0a92230e544468707ab961059e7d2-top, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9682b073ddd338bc11e5321fab7a4eaa/cf/abe04ef65c404865bc4eb79f2b80db95.63a89fe5298deff6125bc77e6a62cb8e->hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63a89fe5298deff6125bc77e6a62cb8e/cf/abe04ef65c404865bc4eb79f2b80db95-top] hfiles 2023-10-01 22:02:34,741 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9682b073ddd338bc11e5321fab7a4eaa/cf/46d0a92230e544468707ab961059e7d2.510042633b7ccf8290114fe1a94ea346 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,742 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9682b073ddd338bc11e5321fab7a4eaa/cf/abe04ef65c404865bc4eb79f2b80db95.63a89fe5298deff6125bc77e6a62cb8e for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,742 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-01 22:02:34,742 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-01 22:02:34,742 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:34,742 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:34,742 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-01 22:02:34,743 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-01 22:02:34,753 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752931.9682b073ddd338bc11e5321fab7a4eaa. completed. 2023-10-01 22:02:34,753 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752931.9682b073ddd338bc11e5321fab7a4eaa. 2023-10-01 22:02:34,753 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 22:02:34,753 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 22:02:34,753 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:34,753 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-01 22:02:34,753 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39235,1696197680862' in zk 2023-10-01 22:02:34,759 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-01 22:02:34,759 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:34,759 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:34,759 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-01 22:02:34,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:34,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:34,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:34,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:34,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:34,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:34,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:34,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:34,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:34,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:34,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:34,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:34,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,39235,1696197680862': 2023-10-01 22:02:34,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39235,1696197680862' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-10-01 22:02:34,762 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-10-01 22:02:34,762 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 22:02:34,762 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 22:02:34,762 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,762 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 22:02:34,763 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,763 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:34,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:34,763 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:34,763 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,763 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,764 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:34,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:34,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,764 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:34,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:34,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,764 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:34,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:34,765 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:34,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:34,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:34,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:34,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:34,765 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:34,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:34,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:34,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:34,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:34,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:34,767 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:34,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,767 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:34,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:34,767 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:34,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:34,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:34,770 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:34,770 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:34,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:34,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:34,770 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:34,770 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:34,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:34,770 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:34,770 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:34,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:34,770 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:34,770 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:34,771 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:34,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:34,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:34,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:34,770 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,770 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:34,771 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:34,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:34,771 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:34,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:34,771 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:34,771 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,771 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:34,771 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,771 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:34,771 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:34,771 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,771 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,792 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-10-01 22:02:34,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,793 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,793 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1696197754710Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696197754770 (+60 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696197754770Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696197754773 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696197754784 (+11 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1696197754792 (+8 ms) 2023-10-01 22:02:34,795 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-01 22:02:34,796 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 82 msec 2023-10-01 22:02:34,813 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 22:02:34,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-10-01 22:02:34,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 22:02:34,814 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197754814 2023-10-01 22:02:34,815 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36919, tgtDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197754814, rawTgtDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197754814, srcFsUri=hdfs://localhost:36919, srcDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9 2023-10-01 22:02:34,837 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36919, inputRoot=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9 2023-10-01 22:02:34,837 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1153393364_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197754814, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197754814/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,837 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36919, inputRoot=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9, snapshotDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-10-01 22:02:34,846 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197754814/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:34,867 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:34,868 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:34,868 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:34,868 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:35,738 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/hadoop-3916856895095780575.jar 2023-10-01 22:02:35,738 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:35,739 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:35,805 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/hadoop-7255808758449408401.jar 2023-10-01 22:02:35,805 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:35,805 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:35,806 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:35,806 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:35,807 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:35,807 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:35,807 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 22:02:35,808 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 22:02:35,808 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 22:02:35,808 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 22:02:35,809 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 22:02:35,809 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 22:02:35,809 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 22:02:35,810 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 22:02:35,810 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 22:02:35,811 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 22:02:35,811 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 22:02:35,811 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 22:02:35,812 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 22:02:35,812 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 22:02:35,812 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 22:02:35,813 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 22:02:35,813 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 22:02:36,150 WARN [Listener at jenkins-hbase4.apache.org/45715] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 22:02:36,153 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-10-01 22:02:36,154 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-10-01 22:02:36,270 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 22:02:36,271 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 22:02:36,273 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696197687246_0004_000001 (auth:SIMPLE) 2023-10-01 22:02:37,059 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 22:02:37,260 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696197687246_0005_000001 (auth:SIMPLE) 2023-10-01 22:02:40,860 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696197687246_0005_000001 (auth:SIMPLE) 2023-10-01 22:02:43,071 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696197687246_0005_000001 (auth:SIMPLE) 2023-10-01 22:02:45,419 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696197687246_0005_000001 (auth:SIMPLE) 2023-10-01 22:02:47,320 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 22:02:47,323 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 22:02:47,333 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:47,333 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 22:02:47,334 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 22:02:47,334 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1693241814_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:47,334 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(367): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-01 22:02:47,335 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(367): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-01 22:02:47,335 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1693241814_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197754814/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197754814/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:47,335 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(367): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197754814/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-01 22:02:47,335 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(367): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197754814/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-01 22:02:47,341 INFO [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:47,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:47,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:47,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-01 22:02:47,346 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696197767345"}]},"ts":"1696197767345"} 2023-10-01 22:02:47,347 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-10-01 22:02:47,348 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-10-01 22:02:47,349 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9682b073ddd338bc11e5321fab7a4eaa, UNASSIGN}] 2023-10-01 22:02:47,351 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9682b073ddd338bc11e5321fab7a4eaa, UNASSIGN 2023-10-01 22:02:47,351 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=9682b073ddd338bc11e5321fab7a4eaa, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:47,352 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752931.9682b073ddd338bc11e5321fab7a4eaa.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696197767351"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696197767351"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696197767351"}]},"ts":"1696197767351"} 2023-10-01 22:02:47,353 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 9682b073ddd338bc11e5321fab7a4eaa, server=jenkins-hbase4.apache.org,39235,1696197680862}] 2023-10-01 22:02:47,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-01 22:02:47,505 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9682b073ddd338bc11e5321fab7a4eaa 2023-10-01 22:02:47,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9682b073ddd338bc11e5321fab7a4eaa, disabling compactions & flushes 2023-10-01 22:02:47,505 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752931.9682b073ddd338bc11e5321fab7a4eaa. 2023-10-01 22:02:47,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752931.9682b073ddd338bc11e5321fab7a4eaa. 2023-10-01 22:02:47,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752931.9682b073ddd338bc11e5321fab7a4eaa. after waiting 0 ms 2023-10-01 22:02:47,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752931.9682b073ddd338bc11e5321fab7a4eaa. 2023-10-01 22:02:47,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9682b073ddd338bc11e5321fab7a4eaa/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-10-01 22:02:47,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 22:02:47,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752931.9682b073ddd338bc11e5321fab7a4eaa. 2023-10-01 22:02:47,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9682b073ddd338bc11e5321fab7a4eaa: 2023-10-01 22:02:47,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9682b073ddd338bc11e5321fab7a4eaa 2023-10-01 22:02:47,518 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=9682b073ddd338bc11e5321fab7a4eaa, regionState=CLOSED 2023-10-01 22:02:47,518 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752931.9682b073ddd338bc11e5321fab7a4eaa.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696197767518"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696197767518"}]},"ts":"1696197767518"} 2023-10-01 22:02:47,521 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-10-01 22:02:47,521 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 9682b073ddd338bc11e5321fab7a4eaa, server=jenkins-hbase4.apache.org,39235,1696197680862 in 166 msec 2023-10-01 22:02:47,522 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-10-01 22:02:47,522 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9682b073ddd338bc11e5321fab7a4eaa, UNASSIGN in 172 msec 2023-10-01 22:02:47,523 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696197767523"}]},"ts":"1696197767523"} 2023-10-01 22:02:47,524 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-10-01 22:02:47,525 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-10-01 22:02:47,527 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 184 msec 2023-10-01 22:02:47,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-01 22:02:47,647 INFO [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-10-01 22:02:47,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:47,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:47,651 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:47,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:47,652 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:47,653 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37145] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:47,656 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:47,656 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:47,656 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:47,656 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:47,656 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/510042633b7ccf8290114fe1a94ea346 2023-10-01 22:02:47,656 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9682b073ddd338bc11e5321fab7a4eaa 2023-10-01 22:02:47,656 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63a89fe5298deff6125bc77e6a62cb8e 2023-10-01 22:02:47,657 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-01 22:02:47,657 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-01 22:02:47,657 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-01 22:02:47,657 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-01 22:02:47,658 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:47,658 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:47,658 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:47,658 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:47,658 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:47,658 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:47,658 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:47,658 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:47,659 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 22:02:47,659 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 22:02:47,659 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 22:02:47,659 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/510042633b7ccf8290114fe1a94ea346/cf, FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/510042633b7ccf8290114fe1a94ea346/recovered.edits] 2023-10-01 22:02:47,659 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 22:02:47,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-01 22:02:47,659 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9682b073ddd338bc11e5321fab7a4eaa/cf, FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9682b073ddd338bc11e5321fab7a4eaa/recovered.edits] 2023-10-01 22:02:47,660 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63a89fe5298deff6125bc77e6a62cb8e/cf, FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63a89fe5298deff6125bc77e6a62cb8e/recovered.edits] 2023-10-01 22:02:47,664 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9682b073ddd338bc11e5321fab7a4eaa/cf/46d0a92230e544468707ab961059e7d2.510042633b7ccf8290114fe1a94ea346 to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9682b073ddd338bc11e5321fab7a4eaa/cf/46d0a92230e544468707ab961059e7d2.510042633b7ccf8290114fe1a94ea346 2023-10-01 22:02:47,664 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/510042633b7ccf8290114fe1a94ea346/cf/46d0a92230e544468707ab961059e7d2 to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/510042633b7ccf8290114fe1a94ea346/cf/46d0a92230e544468707ab961059e7d2 2023-10-01 22:02:47,665 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63a89fe5298deff6125bc77e6a62cb8e/cf/abe04ef65c404865bc4eb79f2b80db95 to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63a89fe5298deff6125bc77e6a62cb8e/cf/abe04ef65c404865bc4eb79f2b80db95 2023-10-01 22:02:47,666 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9682b073ddd338bc11e5321fab7a4eaa/cf/abe04ef65c404865bc4eb79f2b80db95.63a89fe5298deff6125bc77e6a62cb8e to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9682b073ddd338bc11e5321fab7a4eaa/cf/abe04ef65c404865bc4eb79f2b80db95.63a89fe5298deff6125bc77e6a62cb8e 2023-10-01 22:02:47,668 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/510042633b7ccf8290114fe1a94ea346/recovered.edits/8.seqid to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/510042633b7ccf8290114fe1a94ea346/recovered.edits/8.seqid 2023-10-01 22:02:47,669 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/510042633b7ccf8290114fe1a94ea346 2023-10-01 22:02:47,669 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63a89fe5298deff6125bc77e6a62cb8e/recovered.edits/8.seqid to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63a89fe5298deff6125bc77e6a62cb8e/recovered.edits/8.seqid 2023-10-01 22:02:47,670 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9682b073ddd338bc11e5321fab7a4eaa/recovered.edits/12.seqid to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9682b073ddd338bc11e5321fab7a4eaa/recovered.edits/12.seqid 2023-10-01 22:02:47,670 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63a89fe5298deff6125bc77e6a62cb8e 2023-10-01 22:02:47,670 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9682b073ddd338bc11e5321fab7a4eaa 2023-10-01 22:02:47,670 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-01 22:02:47,672 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:47,675 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-10-01 22:02:47,677 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-10-01 22:02:47,678 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:47,678 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-10-01 22:02:47,678 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752931.9682b073ddd338bc11e5321fab7a4eaa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696197767678"}]},"ts":"9223372036854775807"} 2023-10-01 22:02:47,680 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-10-01 22:02:47,680 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9682b073ddd338bc11e5321fab7a4eaa, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696197752931.9682b073ddd338bc11e5321fab7a4eaa.', STARTKEY => '', ENDKEY => ''}] 2023-10-01 22:02:47,680 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-10-01 22:02:47,680 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696197767680"}]},"ts":"9223372036854775807"} 2023-10-01 22:02:47,681 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-10-01 22:02:47,683 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:47,689 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 35 msec 2023-10-01 22:02:47,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-01 22:02:47,760 INFO [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-10-01 22:02:47,761 INFO [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:47,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:47,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:47,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-01 22:02:47,765 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696197767765"}]},"ts":"1696197767765"} 2023-10-01 22:02:47,767 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-10-01 22:02:47,768 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-10-01 22:02:47,769 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bc6946692b723b511cceb3e0532a000d, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f858c713b76c298ec152c5087370d038, UNASSIGN}] 2023-10-01 22:02:47,770 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bc6946692b723b511cceb3e0532a000d, UNASSIGN 2023-10-01 22:02:47,770 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f858c713b76c298ec152c5087370d038, UNASSIGN 2023-10-01 22:02:47,771 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=bc6946692b723b511cceb3e0532a000d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:47,771 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=f858c713b76c298ec152c5087370d038, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:47,771 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696197767771"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696197767771"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696197767771"}]},"ts":"1696197767771"} 2023-10-01 22:02:47,771 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696197767771"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696197767771"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696197767771"}]},"ts":"1696197767771"} 2023-10-01 22:02:47,772 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure bc6946692b723b511cceb3e0532a000d, server=jenkins-hbase4.apache.org,42263,1696197680774}] 2023-10-01 22:02:47,773 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure f858c713b76c298ec152c5087370d038, server=jenkins-hbase4.apache.org,39235,1696197680862}] 2023-10-01 22:02:47,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-01 22:02:47,924 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bc6946692b723b511cceb3e0532a000d 2023-10-01 22:02:47,924 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f858c713b76c298ec152c5087370d038 2023-10-01 22:02:47,924 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bc6946692b723b511cceb3e0532a000d, disabling compactions & flushes 2023-10-01 22:02:47,924 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f858c713b76c298ec152c5087370d038, disabling compactions & flushes 2023-10-01 22:02:47,924 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d. 2023-10-01 22:02:47,924 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038. 2023-10-01 22:02:47,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d. 2023-10-01 22:02:47,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038. 2023-10-01 22:02:47,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d. after waiting 0 ms 2023-10-01 22:02:47,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d. 2023-10-01 22:02:47,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038. after waiting 0 ms 2023-10-01 22:02:47,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038. 2023-10-01 22:02:47,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion/f858c713b76c298ec152c5087370d038/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 22:02:47,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc6946692b723b511cceb3e0532a000d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 22:02:47,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 22:02:47,936 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 22:02:47,936 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038. 2023-10-01 22:02:47,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f858c713b76c298ec152c5087370d038: 2023-10-01 22:02:47,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d. 2023-10-01 22:02:47,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bc6946692b723b511cceb3e0532a000d: 2023-10-01 22:02:47,938 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f858c713b76c298ec152c5087370d038 2023-10-01 22:02:47,938 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=f858c713b76c298ec152c5087370d038, regionState=CLOSED 2023-10-01 22:02:47,939 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bc6946692b723b511cceb3e0532a000d 2023-10-01 22:02:47,939 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696197767938"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696197767938"}]},"ts":"1696197767938"} 2023-10-01 22:02:47,939 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=bc6946692b723b511cceb3e0532a000d, regionState=CLOSED 2023-10-01 22:02:47,939 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696197767939"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696197767939"}]},"ts":"1696197767939"} 2023-10-01 22:02:47,941 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-10-01 22:02:47,942 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure f858c713b76c298ec152c5087370d038, server=jenkins-hbase4.apache.org,39235,1696197680862 in 167 msec 2023-10-01 22:02:47,942 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-10-01 22:02:47,942 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure bc6946692b723b511cceb3e0532a000d, server=jenkins-hbase4.apache.org,42263,1696197680774 in 169 msec 2023-10-01 22:02:47,942 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f858c713b76c298ec152c5087370d038, UNASSIGN in 172 msec 2023-10-01 22:02:47,944 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=84 2023-10-01 22:02:47,944 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bc6946692b723b511cceb3e0532a000d, UNASSIGN in 174 msec 2023-10-01 22:02:47,944 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696197767944"}]},"ts":"1696197767944"} 2023-10-01 22:02:47,945 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-10-01 22:02:47,947 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-10-01 22:02:47,949 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 187 msec 2023-10-01 22:02:48,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-01 22:02:48,067 INFO [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-10-01 22:02:48,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:48,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:48,071 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:48,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:48,071 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:48,073 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37145] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:48,075 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:48,075 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:48,075 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:48,075 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:48,075 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-01 22:02:48,075 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-01 22:02:48,075 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-01 22:02:48,075 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-01 22:02:48,076 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc6946692b723b511cceb3e0532a000d 2023-10-01 22:02:48,076 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f858c713b76c298ec152c5087370d038 2023-10-01 22:02:48,076 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:48,076 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:48,076 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:48,076 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:48,076 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:48,076 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:48,077 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:48,077 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:48,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-01 22:02:48,078 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc6946692b723b511cceb3e0532a000d/cf, FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc6946692b723b511cceb3e0532a000d/recovered.edits] 2023-10-01 22:02:48,078 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f858c713b76c298ec152c5087370d038/cf, FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f858c713b76c298ec152c5087370d038/recovered.edits] 2023-10-01 22:02:48,081 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc6946692b723b511cceb3e0532a000d/cf/eebfc17fe3e441f38ee0cdcd4e298a5f to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc6946692b723b511cceb3e0532a000d/cf/eebfc17fe3e441f38ee0cdcd4e298a5f 2023-10-01 22:02:48,081 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f858c713b76c298ec152c5087370d038/cf/43346e94f76c42fa8c20b55016893ef2 to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/f858c713b76c298ec152c5087370d038/cf/43346e94f76c42fa8c20b55016893ef2 2023-10-01 22:02:48,084 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc6946692b723b511cceb3e0532a000d/recovered.edits/9.seqid to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc6946692b723b511cceb3e0532a000d/recovered.edits/9.seqid 2023-10-01 22:02:48,084 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f858c713b76c298ec152c5087370d038/recovered.edits/9.seqid to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/f858c713b76c298ec152c5087370d038/recovered.edits/9.seqid 2023-10-01 22:02:48,085 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f858c713b76c298ec152c5087370d038 2023-10-01 22:02:48,085 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bc6946692b723b511cceb3e0532a000d 2023-10-01 22:02:48,085 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-01 22:02:48,085 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-01 22:02:48,086 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-10-01 22:02:48,089 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023100198b66943328f4472aeed7f75faa0d8d8 to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023100198b66943328f4472aeed7f75faa0d8d8 2023-10-01 22:02:48,090 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310012f8bbd8923fd4e6886e29df6112fbe86 to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310012f8bbd8923fd4e6886e29df6112fbe86 2023-10-01 22:02:48,090 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-01 22:02:48,092 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:48,094 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-10-01 22:02:48,096 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-10-01 22:02:48,097 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:48,097 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-10-01 22:02:48,097 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696197768097"}]},"ts":"9223372036854775807"} 2023-10-01 22:02:48,098 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696197768097"}]},"ts":"9223372036854775807"} 2023-10-01 22:02:48,099 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-01 22:02:48,099 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => bc6946692b723b511cceb3e0532a000d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696197751781.bc6946692b723b511cceb3e0532a000d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f858c713b76c298ec152c5087370d038, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696197751781.f858c713b76c298ec152c5087370d038.', STARTKEY => '1', ENDKEY => ''}] 2023-10-01 22:02:48,099 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-10-01 22:02:48,099 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696197768099"}]},"ts":"9223372036854775807"} 2023-10-01 22:02:48,101 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-10-01 22:02:48,103 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:48,104 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 35 msec 2023-10-01 22:02:48,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-01 22:02:48,179 INFO [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-10-01 22:02:48,187 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-01 22:02:48,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:48,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-01 22:02:48,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 22:02:48,193 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-10-01 22:02:48,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 22:02:48,218 INFO [Listener at jenkins-hbase4.apache.org/45715] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=757 (was 749) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_280617401_1 at /127.0.0.1:34568 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:41475 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_280617401_1 at /127.0.0.1:50534 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1693241814_17 at /127.0.0.1:50576 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6cc451db-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6cc451db-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6cc451db-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6cc451db-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6cc451db-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1693241814_17 at /127.0.0.1:34586 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6cc451db-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3954 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1693241814_17 at /127.0.0.1:48192 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=912 (was 904) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=173 (was 204), ProcessCount=168 (was 168), AvailableMemoryMB=1296 (was 1349) 2023-10-01 22:02:48,218 WARN [Listener at jenkins-hbase4.apache.org/45715] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-10-01 22:02:48,237 INFO [Listener at jenkins-hbase4.apache.org/45715] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=757, OpenFileDescriptor=912, MaxFileDescriptor=60000, SystemLoadAverage=173, ProcessCount=168, AvailableMemoryMB=1296 2023-10-01 22:02:48,238 WARN [Listener at jenkins-hbase4.apache.org/45715] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-10-01 22:02:48,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-01 22:02:48,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 22:02:48,242 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 22:02:48,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-10-01 22:02:48,243 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 22:02:48,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-01 22:02:48,245 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testEmptyExportFileSystemState/6c9d0c2f633373dab954a6c1770e7bfb 2023-10-01 22:02:48,245 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testEmptyExportFileSystemState/a5e2bcc43caec095b38a33c438caaee7 2023-10-01 22:02:48,246 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testEmptyExportFileSystemState/6c9d0c2f633373dab954a6c1770e7bfb empty. 2023-10-01 22:02:48,246 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testEmptyExportFileSystemState/a5e2bcc43caec095b38a33c438caaee7 empty. 2023-10-01 22:02:48,246 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testEmptyExportFileSystemState/6c9d0c2f633373dab954a6c1770e7bfb 2023-10-01 22:02:48,246 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testEmptyExportFileSystemState/a5e2bcc43caec095b38a33c438caaee7 2023-10-01 22:02:48,246 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-01 22:02:48,256 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-01 22:02:48,257 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6c9d0c2f633373dab954a6c1770e7bfb, NAME => 'testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp 2023-10-01 22:02:48,257 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => a5e2bcc43caec095b38a33c438caaee7, NAME => 'testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp 2023-10-01 22:02:48,265 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:02:48,265 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing a5e2bcc43caec095b38a33c438caaee7, disabling compactions & flushes 2023-10-01 22:02:48,265 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7. 2023-10-01 22:02:48,265 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7. 2023-10-01 22:02:48,265 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7. after waiting 0 ms 2023-10-01 22:02:48,265 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7. 2023-10-01 22:02:48,265 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7. 2023-10-01 22:02:48,265 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for a5e2bcc43caec095b38a33c438caaee7: 2023-10-01 22:02:48,266 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:02:48,266 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 6c9d0c2f633373dab954a6c1770e7bfb, disabling compactions & flushes 2023-10-01 22:02:48,266 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb. 2023-10-01 22:02:48,266 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb. 2023-10-01 22:02:48,266 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb. after waiting 0 ms 2023-10-01 22:02:48,266 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb. 2023-10-01 22:02:48,266 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb. 2023-10-01 22:02:48,266 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 6c9d0c2f633373dab954a6c1770e7bfb: 2023-10-01 22:02:48,268 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 22:02:48,269 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696197768268"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696197768268"}]},"ts":"1696197768268"} 2023-10-01 22:02:48,269 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696197768268"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696197768268"}]},"ts":"1696197768268"} 2023-10-01 22:02:48,270 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 22:02:48,271 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 22:02:48,271 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696197768271"}]},"ts":"1696197768271"} 2023-10-01 22:02:48,272 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-10-01 22:02:48,275 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 22:02:48,276 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 22:02:48,276 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 22:02:48,276 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 22:02:48,276 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 22:02:48,276 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6c9d0c2f633373dab954a6c1770e7bfb, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a5e2bcc43caec095b38a33c438caaee7, ASSIGN}] 2023-10-01 22:02:48,279 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6c9d0c2f633373dab954a6c1770e7bfb, ASSIGN 2023-10-01 22:02:48,279 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a5e2bcc43caec095b38a33c438caaee7, ASSIGN 2023-10-01 22:02:48,279 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6c9d0c2f633373dab954a6c1770e7bfb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37145,1696197680825; forceNewPlan=false, retain=false 2023-10-01 22:02:48,279 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a5e2bcc43caec095b38a33c438caaee7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42263,1696197680774; forceNewPlan=false, retain=false 2023-10-01 22:02:48,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-01 22:02:48,430 INFO [jenkins-hbase4:40311] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 22:02:48,432 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=a5e2bcc43caec095b38a33c438caaee7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:48,432 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=6c9d0c2f633373dab954a6c1770e7bfb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:48,432 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696197768432"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696197768432"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696197768432"}]},"ts":"1696197768432"} 2023-10-01 22:02:48,432 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696197768432"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696197768432"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696197768432"}]},"ts":"1696197768432"} 2023-10-01 22:02:48,434 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure a5e2bcc43caec095b38a33c438caaee7, server=jenkins-hbase4.apache.org,42263,1696197680774}] 2023-10-01 22:02:48,435 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 6c9d0c2f633373dab954a6c1770e7bfb, server=jenkins-hbase4.apache.org,37145,1696197680825}] 2023-10-01 22:02:48,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-01 22:02:48,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7. 2023-10-01 22:02:48,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a5e2bcc43caec095b38a33c438caaee7, NAME => 'testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7.', STARTKEY => '1', ENDKEY => ''} 2023-10-01 22:02:48,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb. 2023-10-01 22:02:48,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7. service=AccessControlService 2023-10-01 22:02:48,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6c9d0c2f633373dab954a6c1770e7bfb, NAME => 'testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb.', STARTKEY => '', ENDKEY => '1'} 2023-10-01 22:02:48,593 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 22:02:48,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb. service=AccessControlService 2023-10-01 22:02:48,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState a5e2bcc43caec095b38a33c438caaee7 2023-10-01 22:02:48,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:02:48,593 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 22:02:48,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a5e2bcc43caec095b38a33c438caaee7 2023-10-01 22:02:48,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a5e2bcc43caec095b38a33c438caaee7 2023-10-01 22:02:48,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 6c9d0c2f633373dab954a6c1770e7bfb 2023-10-01 22:02:48,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:02:48,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6c9d0c2f633373dab954a6c1770e7bfb 2023-10-01 22:02:48,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6c9d0c2f633373dab954a6c1770e7bfb 2023-10-01 22:02:48,594 INFO [StoreOpener-a5e2bcc43caec095b38a33c438caaee7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a5e2bcc43caec095b38a33c438caaee7 2023-10-01 22:02:48,594 INFO [StoreOpener-6c9d0c2f633373dab954a6c1770e7bfb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6c9d0c2f633373dab954a6c1770e7bfb 2023-10-01 22:02:48,595 DEBUG [StoreOpener-a5e2bcc43caec095b38a33c438caaee7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testEmptyExportFileSystemState/a5e2bcc43caec095b38a33c438caaee7/cf 2023-10-01 22:02:48,595 DEBUG [StoreOpener-a5e2bcc43caec095b38a33c438caaee7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testEmptyExportFileSystemState/a5e2bcc43caec095b38a33c438caaee7/cf 2023-10-01 22:02:48,595 DEBUG [StoreOpener-6c9d0c2f633373dab954a6c1770e7bfb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testEmptyExportFileSystemState/6c9d0c2f633373dab954a6c1770e7bfb/cf 2023-10-01 22:02:48,596 DEBUG [StoreOpener-6c9d0c2f633373dab954a6c1770e7bfb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testEmptyExportFileSystemState/6c9d0c2f633373dab954a6c1770e7bfb/cf 2023-10-01 22:02:48,596 INFO [StoreOpener-a5e2bcc43caec095b38a33c438caaee7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5e2bcc43caec095b38a33c438caaee7 columnFamilyName cf 2023-10-01 22:02:48,596 INFO [StoreOpener-6c9d0c2f633373dab954a6c1770e7bfb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6c9d0c2f633373dab954a6c1770e7bfb columnFamilyName cf 2023-10-01 22:02:48,597 INFO [StoreOpener-6c9d0c2f633373dab954a6c1770e7bfb-1] regionserver.HStore(310): Store=6c9d0c2f633373dab954a6c1770e7bfb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 22:02:48,597 INFO [StoreOpener-a5e2bcc43caec095b38a33c438caaee7-1] regionserver.HStore(310): Store=a5e2bcc43caec095b38a33c438caaee7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 22:02:48,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testEmptyExportFileSystemState/a5e2bcc43caec095b38a33c438caaee7 2023-10-01 22:02:48,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testEmptyExportFileSystemState/6c9d0c2f633373dab954a6c1770e7bfb 2023-10-01 22:02:48,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testEmptyExportFileSystemState/a5e2bcc43caec095b38a33c438caaee7 2023-10-01 22:02:48,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testEmptyExportFileSystemState/6c9d0c2f633373dab954a6c1770e7bfb 2023-10-01 22:02:48,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a5e2bcc43caec095b38a33c438caaee7 2023-10-01 22:02:48,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6c9d0c2f633373dab954a6c1770e7bfb 2023-10-01 22:02:48,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testEmptyExportFileSystemState/a5e2bcc43caec095b38a33c438caaee7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 22:02:48,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testEmptyExportFileSystemState/6c9d0c2f633373dab954a6c1770e7bfb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 22:02:48,603 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a5e2bcc43caec095b38a33c438caaee7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74260159, jitterRate=0.10656259953975677}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 22:02:48,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a5e2bcc43caec095b38a33c438caaee7: 2023-10-01 22:02:48,604 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6c9d0c2f633373dab954a6c1770e7bfb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65121242, jitterRate=-0.029617875814437866}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 22:02:48,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6c9d0c2f633373dab954a6c1770e7bfb: 2023-10-01 22:02:48,604 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7., pid=93, masterSystemTime=1696197768587 2023-10-01 22:02:48,604 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb., pid=94, masterSystemTime=1696197768587 2023-10-01 22:02:48,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7. 2023-10-01 22:02:48,606 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7. 2023-10-01 22:02:48,606 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=a5e2bcc43caec095b38a33c438caaee7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:48,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb. 2023-10-01 22:02:48,606 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb. 2023-10-01 22:02:48,606 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696197768606"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696197768606"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696197768606"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696197768606"}]},"ts":"1696197768606"} 2023-10-01 22:02:48,607 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=6c9d0c2f633373dab954a6c1770e7bfb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:48,607 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696197768607"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696197768607"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696197768607"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696197768607"}]},"ts":"1696197768607"} 2023-10-01 22:02:48,609 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-10-01 22:02:48,609 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure a5e2bcc43caec095b38a33c438caaee7, server=jenkins-hbase4.apache.org,42263,1696197680774 in 174 msec 2023-10-01 22:02:48,610 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-10-01 22:02:48,610 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 6c9d0c2f633373dab954a6c1770e7bfb, server=jenkins-hbase4.apache.org,37145,1696197680825 in 173 msec 2023-10-01 22:02:48,610 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a5e2bcc43caec095b38a33c438caaee7, ASSIGN in 333 msec 2023-10-01 22:02:48,611 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-10-01 22:02:48,612 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6c9d0c2f633373dab954a6c1770e7bfb, ASSIGN in 334 msec 2023-10-01 22:02:48,612 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 22:02:48,612 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696197768612"}]},"ts":"1696197768612"} 2023-10-01 22:02:48,613 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-10-01 22:02:48,615 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 22:02:48,615 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-10-01 22:02:48,617 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37145] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-01 22:02:48,619 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:48,619 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:48,619 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:48,619 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:48,620 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 22:02:48,620 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 22:02:48,620 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 22:02:48,620 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 22:02:48,621 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 381 msec 2023-10-01 22:02:48,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-01 22:02:48,847 INFO [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-10-01 22:02:48,849 DEBUG [Listener at jenkins-hbase4.apache.org/45715] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-01 22:02:48,849 DEBUG [Listener at jenkins-hbase4.apache.org/45715] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb. 2023-10-01 22:02:48,851 INFO [Listener at jenkins-hbase4.apache.org/45715] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 22:02:48,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 22:02:48,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696197768861 (current time:1696197768861). 2023-10-01 22:02:48,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 22:02:48,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(139): Connect 0x212efe70 to 127.0.0.1:58905 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 22:02:48,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49620d97, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 22:02:48,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:02:48,872 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43380, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:02:48,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x212efe70 to 127.0.0.1:58905 2023-10-01 22:02:48,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:02:48,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(139): Connect 0x193970a2 to 127.0.0.1:58905 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 22:02:48,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fb2d08b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 22:02:48,880 DEBUG [hconnection-0x1665625f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:02:48,883 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43388, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:02:48,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:02:48,888 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57508, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:02:48,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x193970a2 to 127.0.0.1:58905 2023-10-01 22:02:48,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:02:48,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-01 22:02:48,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 22:02:48,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 22:02:48,892 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot, current working dir path: hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 22:02:48,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-01 22:02:48,897 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-01 22:02:48,898 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696198368897 2023-10-01 22:02:48,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 22:02:48,898 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-01 22:02:48,898 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 22:02:48,899 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 22:02:48,900 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-01 22:02:48,900 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-01 22:02:48,901 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-10-01 22:02:48,903 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-01 22:02:48,904 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696198368904 2023-10-01 22:02:48,911 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,911 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-10-01 22:02:48,911 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:48,912 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-01 22:02:48,912 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-01 22:02:48,913 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,913 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,918 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:48,918 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:48,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:48,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:48,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:48,918 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:48,918 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:48,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:48,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:48,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:48,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,919 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:48,919 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:48,919 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,919 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,919 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,920 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:48,920 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 22:02:48,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-01 22:02:48,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-01 22:02:48,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-01 22:02:48,920 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-01 22:02:48,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,920 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-01 22:02:48,920 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-01 22:02:48,920 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,920 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-01 22:02:48,920 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:48,926 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-01 22:02:48,926 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,926 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,926 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-01 22:02:48,926 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-01 22:02:48,926 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-01 22:02:48,926 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:48,926 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:48,926 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42263,1696197680774' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-01 22:02:48,928 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-01 22:02:48,928 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-01 22:02:48,927 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-01 22:02:48,928 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-01 22:02:48,928 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39235,1696197680862' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-01 22:02:48,928 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37145,1696197680825' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-01 22:02:48,935 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:48,935 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:48,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:48,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:48,936 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,937 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:48,937 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:48,937 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,937 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:02:48,937 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,937 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:02:48,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:48,937 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,937 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:02:48,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:48,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:48,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:48,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:48,939 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42263,1696197680774' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-01 22:02:48,939 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76005599[Count = 1] remaining members to acquire global barrier 2023-10-01 22:02:48,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:48,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:48,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:48,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:48,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:48,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:48,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:48,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:48,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:48,941 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37145,1696197680825' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-01 22:02:48,941 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76005599[Count = 0] remaining members to acquire global barrier 2023-10-01 22:02:48,941 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-01 22:02:48,941 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,942 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,942 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,942 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,942 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-01 22:02:48,942 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-01 22:02:48,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,942 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39235,1696197680862' in zk 2023-10-01 22:02:48,942 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-01 22:02:48,942 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:48,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,942 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-01 22:02:48,942 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 22:02:48,942 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 22:02:48,942 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 22:02:48,942 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 22:02:48,942 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7. 2023-10-01 22:02:48,942 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:48,943 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 22:02:48,943 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7. started... 2023-10-01 22:02:48,942 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb. 2023-10-01 22:02:48,943 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb. started... 2023-10-01 22:02:48,944 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a5e2bcc43caec095b38a33c438caaee7: 2023-10-01 22:02:48,944 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6c9d0c2f633373dab954a6c1770e7bfb: 2023-10-01 22:02:48,944 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,944 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 22:02:48,944 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 22:02:48,944 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,944 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 22:02:48,944 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 22:02:48,945 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-01 22:02:48,945 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:48,945 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-01 22:02:48,957 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7. completed. 2023-10-01 22:02:48,957 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7. 2023-10-01 22:02:48,957 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 22:02:48,957 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 22:02:48,957 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:48,957 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-01 22:02:48,957 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42263,1696197680774' in zk 2023-10-01 22:02:48,957 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb. completed. 2023-10-01 22:02:48,957 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb. 2023-10-01 22:02:48,957 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 22:02:48,957 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 22:02:48,957 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:48,957 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-01 22:02:48,958 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37145,1696197680825' in zk 2023-10-01 22:02:48,958 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-01 22:02:48,958 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:48,958 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:48,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:48,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:48,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:48,958 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-01 22:02:48,960 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:48,960 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-01 22:02:48,960 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:48,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:48,960 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-01 22:02:48,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:48,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:48,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:48,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:48,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:48,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:48,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:48,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:48,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,42263,1696197680774': 2023-10-01 22:02:48,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42263,1696197680774' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-01 22:02:48,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:48,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:48,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:48,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:48,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:48,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:48,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:48,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:48,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:48,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:48,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:48,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:48,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37145,1696197680825': 2023-10-01 22:02:48,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37145,1696197680825' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-01 22:02:48,967 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-10-01 22:02:48,967 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 22:02:48,967 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 22:02:48,967 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,967 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 22:02:48,969 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,969 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,969 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,969 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:48,969 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,969 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:48,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,969 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:48,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,969 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:48,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:48,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:48,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:48,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:48,970 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:48,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:48,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:48,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:48,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:48,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:48,970 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:48,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:48,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:48,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:48,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:48,973 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:48,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:48,973 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:48,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,973 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:48,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:48,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:48,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:48,978 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:48,978 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,978 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:48,978 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:48,978 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,978 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:48,978 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,978 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:48,978 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:48,978 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,978 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:48,978 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-01 22:02:48,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:48,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:48,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 22:02:48,978 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:48,978 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,978 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:48,978 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:48,978 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:48,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:48,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:48,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:48,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:48,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:48,980 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:48,980 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:48,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-01 22:02:48,978 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:48,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:48,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:48,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:48,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:48,987 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,987 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:48,999 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 22:02:49,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 22:02:49,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-01 22:02:49,000 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 22:02:49,009 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,010 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-01 22:02:49,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,010 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696197768898Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696197768987 (+89 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696197768987Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1696197768987Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1696197768990 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696197769004 (+14 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696197769010 (+6 ms) 2023-10-01 22:02:49,013 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-01 22:02:49,015 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 116 msec 2023-10-01 22:02:49,200 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 22:02:49,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 22:02:49,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 22:02:49,203 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37145] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 22:02:49,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42263] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 22:02:49,207 DEBUG [Listener at jenkins-hbase4.apache.org/45715] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-01 22:02:49,207 DEBUG [Listener at jenkins-hbase4.apache.org/45715] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb. 2023-10-01 22:02:49,207 INFO [Listener at jenkins-hbase4.apache.org/45715] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 22:02:49,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 22:02:49,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696197769216 (current time:1696197769216). 2023-10-01 22:02:49,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 22:02:49,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(139): Connect 0x4851ce91 to 127.0.0.1:58905 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 22:02:49,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3de794d9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 22:02:49,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:02:49,227 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:02:49,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4851ce91 to 127.0.0.1:58905 2023-10-01 22:02:49,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:02:49,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(139): Connect 0x578df74e to 127.0.0.1:58905 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 22:02:49,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11ee8e68, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 22:02:49,234 DEBUG [hconnection-0x10ae81d0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:02:49,235 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43406, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:02:49,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:02:49,239 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57524, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:02:49,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x578df74e to 127.0.0.1:58905 2023-10-01 22:02:49,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:02:49,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-01 22:02:49,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 22:02:49,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 22:02:49,243 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot, current working dir path: hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 22:02:49,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-01 22:02:49,245 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-01 22:02:49,246 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696198369246 2023-10-01 22:02:49,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 22:02:49,246 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-01 22:02:49,247 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 22:02:49,247 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 22:02:49,248 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-01 22:02:49,248 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-01 22:02:49,249 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-10-01 22:02:49,249 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-01 22:02:49,250 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696198369250 2023-10-01 22:02:49,260 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,260 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-10-01 22:02:49,260 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:49,261 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-01 22:02:49,261 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-01 22:02:49,261 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,261 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,262 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:49,262 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:49,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:49,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:49,262 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:49,262 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:49,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:49,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:49,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:49,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:49,263 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:49,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,263 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:49,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,263 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,263 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:49,263 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,263 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 22:02:49,263 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-01 22:02:49,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-01 22:02:49,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-01 22:02:49,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,264 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-01 22:02:49,264 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-01 22:02:49,264 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-01 22:02:49,264 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,264 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,264 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,264 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-01 22:02:49,264 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-01 22:02:49,264 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:49,264 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-01 22:02:49,265 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-01 22:02:49,265 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-01 22:02:49,265 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39235,1696197680862' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-01 22:02:49,265 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:49,264 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:49,266 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-01 22:02:49,266 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-01 22:02:49,266 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37145,1696197680825' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-01 22:02:49,269 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-01 22:02:49,269 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-01 22:02:49,269 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42263,1696197680774' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-01 22:02:49,270 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,271 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,271 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,271 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:02:49,271 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,271 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:49,271 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:49,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:49,271 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,271 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:02:49,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:49,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:49,271 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,271 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:02:49,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:49,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:49,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:49,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:49,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:49,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:49,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37145,1696197680825' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-01 22:02:49,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55ba796d[Count = 1] remaining members to acquire global barrier 2023-10-01 22:02:49,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:49,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:49,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:49,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:49,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:49,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:49,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:49,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:49,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:49,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42263,1696197680774' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-01 22:02:49,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55ba796d[Count = 0] remaining members to acquire global barrier 2023-10-01 22:02:49,275 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-01 22:02:49,275 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,282 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,282 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,282 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,283 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-01 22:02:49,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,283 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:49,283 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-01 22:02:49,283 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-01 22:02:49,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,283 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39235,1696197680862' in zk 2023-10-01 22:02:49,283 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-01 22:02:49,283 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb. 2023-10-01 22:02:49,283 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:49,283 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb. started... 2023-10-01 22:02:49,283 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 22:02:49,283 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 22:02:49,283 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7. 2023-10-01 22:02:49,283 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 22:02:49,283 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 22:02:49,283 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 22:02:49,283 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7. started... 2023-10-01 22:02:49,283 INFO [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6c9d0c2f633373dab954a6c1770e7bfb 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-01 22:02:49,284 INFO [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a5e2bcc43caec095b38a33c438caaee7 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-01 22:02:49,284 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-01 22:02:49,284 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:49,284 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-01 22:02:49,325 INFO [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310017cfcf51896754f6f8538c905045cb436 to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310017cfcf51896754f6f8538c905045cb436 2023-10-01 22:02:49,326 INFO [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231001fc440d7f813549bba12d156a27fea7e4 to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231001fc440d7f813549bba12d156a27fea7e4 2023-10-01 22:02:49,333 INFO [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testEmptyExportFileSystemState/6c9d0c2f633373dab954a6c1770e7bfb/.tmp/cf/38524a2a8e9d4e4c8c1d92d6497ed55b 2023-10-01 22:02:49,335 INFO [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testEmptyExportFileSystemState/a5e2bcc43caec095b38a33c438caaee7/.tmp/cf/b3426cfa2a554d62b4139941c0a50e2b 2023-10-01 22:02:49,338 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testEmptyExportFileSystemState/6c9d0c2f633373dab954a6c1770e7bfb/.tmp/cf/38524a2a8e9d4e4c8c1d92d6497ed55b as hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testEmptyExportFileSystemState/6c9d0c2f633373dab954a6c1770e7bfb/cf/38524a2a8e9d4e4c8c1d92d6497ed55b 2023-10-01 22:02:49,340 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testEmptyExportFileSystemState/a5e2bcc43caec095b38a33c438caaee7/.tmp/cf/b3426cfa2a554d62b4139941c0a50e2b as hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testEmptyExportFileSystemState/a5e2bcc43caec095b38a33c438caaee7/cf/b3426cfa2a554d62b4139941c0a50e2b 2023-10-01 22:02:49,342 INFO [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testEmptyExportFileSystemState/6c9d0c2f633373dab954a6c1770e7bfb/cf/38524a2a8e9d4e4c8c1d92d6497ed55b, entries=4, sequenceid=6, filesize=5.6 K 2023-10-01 22:02:49,343 INFO [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 6c9d0c2f633373dab954a6c1770e7bfb in 60ms, sequenceid=6, compaction requested=false 2023-10-01 22:02:49,343 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-10-01 22:02:49,344 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6c9d0c2f633373dab954a6c1770e7bfb: 2023-10-01 22:02:49,344 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,344 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 22:02:49,344 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testEmptyExportFileSystemState/6c9d0c2f633373dab954a6c1770e7bfb/cf/38524a2a8e9d4e4c8c1d92d6497ed55b] hfiles 2023-10-01 22:02:49,344 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testEmptyExportFileSystemState/6c9d0c2f633373dab954a6c1770e7bfb/cf/38524a2a8e9d4e4c8c1d92d6497ed55b for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,344 INFO [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testEmptyExportFileSystemState/a5e2bcc43caec095b38a33c438caaee7/cf/b3426cfa2a554d62b4139941c0a50e2b, entries=46, sequenceid=6, filesize=12.9 K 2023-10-01 22:02:49,345 INFO [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for a5e2bcc43caec095b38a33c438caaee7 in 62ms, sequenceid=6, compaction requested=false 2023-10-01 22:02:49,347 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a5e2bcc43caec095b38a33c438caaee7: 2023-10-01 22:02:49,347 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,347 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 22:02:49,348 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 22:02:49,348 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testEmptyExportFileSystemState/a5e2bcc43caec095b38a33c438caaee7/cf/b3426cfa2a554d62b4139941c0a50e2b] hfiles 2023-10-01 22:02:49,348 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testEmptyExportFileSystemState/a5e2bcc43caec095b38a33c438caaee7/cf/b3426cfa2a554d62b4139941c0a50e2b for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 22:02:49,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-01 22:02:49,349 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 22:02:49,354 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb. completed. 2023-10-01 22:02:49,354 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb. 2023-10-01 22:02:49,354 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 22:02:49,354 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 22:02:49,354 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:49,354 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-01 22:02:49,354 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37145,1696197680825' in zk 2023-10-01 22:02:49,355 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-01 22:02:49,356 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:49,356 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-01 22:02:49,356 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:49,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:49,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:49,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:49,357 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7. completed. 2023-10-01 22:02:49,357 DEBUG [rs(jenkins-hbase4.apache.org,42263,1696197680774)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7. 2023-10-01 22:02:49,357 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 22:02:49,357 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 22:02:49,357 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:49,357 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-01 22:02:49,357 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42263,1696197680774' in zk 2023-10-01 22:02:49,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:49,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:49,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,360 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:49,360 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-01 22:02:49,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:49,360 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:49,360 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-01 22:02:49,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:49,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:49,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:49,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:49,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:49,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:49,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37145,1696197680825': 2023-10-01 22:02:49,364 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37145,1696197680825' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-01 22:02:49,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:49,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:49,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:49,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:49,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:49,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:49,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:49,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:49,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:49,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:49,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:49,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:49,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,42263,1696197680774': 2023-10-01 22:02:49,367 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42263,1696197680774' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-01 22:02:49,367 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-10-01 22:02:49,367 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 22:02:49,367 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 22:02:49,367 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,367 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 22:02:49,369 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,369 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,369 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:49,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:49,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,369 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:49,369 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:49,369 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:49,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,370 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:49,369 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:49,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:49,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:49,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:49,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:49,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:49,370 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:49,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:49,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:49,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,370 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:49,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:49,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:49,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:49,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:49,372 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:49,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,372 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:49,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:49,373 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:49,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:49,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:49,376 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:49,376 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,376 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:49,376 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:49,376 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:49,376 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:49,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:49,376 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:49,376 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:49,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:49,376 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:49,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:49,376 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:49,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:49,377 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,376 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:49,377 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:49,376 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:49,378 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-01 22:02:49,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:49,377 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:49,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:49,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:49,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:49,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:49,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:49,378 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:49,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 22:02:49,378 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:49,378 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,378 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231001fc440d7f813549bba12d156a27fea7e4, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310017cfcf51896754f6f8538c905045cb436] mob files 2023-10-01 22:02:49,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231001fc440d7f813549bba12d156a27fea7e4 2023-10-01 22:02:49,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310017cfcf51896754f6f8538c905045cb436 2023-10-01 22:02:49,386 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,386 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,406 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,407 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-01 22:02:49,407 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,407 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,407 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696197769246Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696197769386 (+140 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1696197769386Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1696197769386Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1696197769389 (+3 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1696197769400 (+11 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696197769407 (+7 ms) 2023-10-01 22:02:49,412 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-01 22:02:49,413 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 165 msec 2023-10-01 22:02:49,550 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 22:02:49,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 22:02:49,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 22:02:49,551 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197769551 2023-10-01 22:02:49,551 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36919, tgtDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197769551, rawTgtDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197769551, srcFsUri=hdfs://localhost:36919, srcDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9 2023-10-01 22:02:49,572 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36919, inputRoot=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9 2023-10-01 22:02:49,573 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-588241985_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197769551, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197769551/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,573 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36919, inputRoot=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9, snapshotDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-10-01 22:02:49,578 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197769551/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:49,600 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:49,600 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:49,601 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:49,601 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:50,468 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/hadoop-3995947276834627652.jar 2023-10-01 22:02:50,469 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:50,469 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:50,535 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/hadoop-4313397422666877217.jar 2023-10-01 22:02:50,536 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:50,536 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:50,537 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:50,537 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:50,537 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:50,538 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 22:02:50,538 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 22:02:50,538 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 22:02:50,539 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 22:02:50,539 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 22:02:50,539 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 22:02:50,540 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 22:02:50,540 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 22:02:50,540 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 22:02:50,541 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 22:02:50,541 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 22:02:50,542 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 22:02:50,542 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 22:02:50,543 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 22:02:50,543 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 22:02:50,543 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 22:02:50,543 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 22:02:50,544 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 22:02:50,903 WARN [Listener at jenkins-hbase4.apache.org/45715] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 22:02:50,905 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-10-01 22:02:51,600 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 22:02:51,601 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 22:02:51,603 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696197687246_0005_000001 (auth:SIMPLE) 2023-10-01 22:02:52,282 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696197687246_0006_000001 (auth:SIMPLE) 2023-10-01 22:02:53,116 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 22:02:55,998 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696197687246_0006_000001 (auth:SIMPLE) 2023-10-01 22:02:58,235 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 22:02:58,236 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 22:02:58,244 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:58,245 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 22:02:58,245 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 22:02:58,245 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1693241814_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:58,246 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(367): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-01 22:02:58,246 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(367): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-01 22:02:58,246 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1693241814_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197769551/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197769551/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:58,246 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(367): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197769551/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-01 22:02:58,246 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(367): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197769551/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-01 22:02:58,252 INFO [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-10-01 22:02:58,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-10-01 22:02:58,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 22:02:58,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-01 22:02:58,256 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696197778256"}]},"ts":"1696197778256"} 2023-10-01 22:02:58,258 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-10-01 22:02:58,259 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-10-01 22:02:58,259 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6c9d0c2f633373dab954a6c1770e7bfb, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a5e2bcc43caec095b38a33c438caaee7, UNASSIGN}] 2023-10-01 22:02:58,261 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6c9d0c2f633373dab954a6c1770e7bfb, UNASSIGN 2023-10-01 22:02:58,261 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a5e2bcc43caec095b38a33c438caaee7, UNASSIGN 2023-10-01 22:02:58,262 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=6c9d0c2f633373dab954a6c1770e7bfb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:58,262 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=a5e2bcc43caec095b38a33c438caaee7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:58,262 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696197778262"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696197778262"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696197778262"}]},"ts":"1696197778262"} 2023-10-01 22:02:58,262 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696197778262"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696197778262"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696197778262"}]},"ts":"1696197778262"} 2023-10-01 22:02:58,263 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 6c9d0c2f633373dab954a6c1770e7bfb, server=jenkins-hbase4.apache.org,37145,1696197680825}] 2023-10-01 22:02:58,264 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure a5e2bcc43caec095b38a33c438caaee7, server=jenkins-hbase4.apache.org,42263,1696197680774}] 2023-10-01 22:02:58,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-01 22:02:58,415 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6c9d0c2f633373dab954a6c1770e7bfb 2023-10-01 22:02:58,415 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a5e2bcc43caec095b38a33c438caaee7 2023-10-01 22:02:58,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6c9d0c2f633373dab954a6c1770e7bfb, disabling compactions & flushes 2023-10-01 22:02:58,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a5e2bcc43caec095b38a33c438caaee7, disabling compactions & flushes 2023-10-01 22:02:58,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb. 2023-10-01 22:02:58,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7. 2023-10-01 22:02:58,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb. 2023-10-01 22:02:58,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7. 2023-10-01 22:02:58,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb. after waiting 0 ms 2023-10-01 22:02:58,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb. 2023-10-01 22:02:58,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7. after waiting 0 ms 2023-10-01 22:02:58,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7. 2023-10-01 22:02:58,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testEmptyExportFileSystemState/6c9d0c2f633373dab954a6c1770e7bfb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 22:02:58,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testEmptyExportFileSystemState/a5e2bcc43caec095b38a33c438caaee7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 22:02:58,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 22:02:58,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 22:02:58,425 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb. 2023-10-01 22:02:58,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6c9d0c2f633373dab954a6c1770e7bfb: 2023-10-01 22:02:58,425 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7. 2023-10-01 22:02:58,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a5e2bcc43caec095b38a33c438caaee7: 2023-10-01 22:02:58,427 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6c9d0c2f633373dab954a6c1770e7bfb 2023-10-01 22:02:58,427 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=6c9d0c2f633373dab954a6c1770e7bfb, regionState=CLOSED 2023-10-01 22:02:58,427 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696197778427"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696197778427"}]},"ts":"1696197778427"} 2023-10-01 22:02:58,427 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a5e2bcc43caec095b38a33c438caaee7 2023-10-01 22:02:58,428 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=a5e2bcc43caec095b38a33c438caaee7, regionState=CLOSED 2023-10-01 22:02:58,428 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696197778428"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696197778428"}]},"ts":"1696197778428"} 2023-10-01 22:02:58,430 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-10-01 22:02:58,430 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 6c9d0c2f633373dab954a6c1770e7bfb, server=jenkins-hbase4.apache.org,37145,1696197680825 in 165 msec 2023-10-01 22:02:58,430 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-10-01 22:02:58,430 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure a5e2bcc43caec095b38a33c438caaee7, server=jenkins-hbase4.apache.org,42263,1696197680774 in 165 msec 2023-10-01 22:02:58,431 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6c9d0c2f633373dab954a6c1770e7bfb, UNASSIGN in 171 msec 2023-10-01 22:02:58,432 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-10-01 22:02:58,432 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a5e2bcc43caec095b38a33c438caaee7, UNASSIGN in 171 msec 2023-10-01 22:02:58,432 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696197778432"}]},"ts":"1696197778432"} 2023-10-01 22:02:58,433 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-10-01 22:02:58,435 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-10-01 22:02:58,436 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 183 msec 2023-10-01 22:02:58,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-01 22:02:58,558 INFO [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-10-01 22:02:58,559 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-10-01 22:02:58,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 22:02:58,561 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 22:02:58,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-10-01 22:02:58,562 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 22:02:58,563 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37145] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-10-01 22:02:58,566 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testEmptyExportFileSystemState/6c9d0c2f633373dab954a6c1770e7bfb 2023-10-01 22:02:58,566 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testEmptyExportFileSystemState/a5e2bcc43caec095b38a33c438caaee7 2023-10-01 22:02:58,567 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 22:02:58,567 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 22:02:58,567 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 22:02:58,567 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 22:02:58,567 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-01 22:02:58,567 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-01 22:02:58,567 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-01 22:02:58,567 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-01 22:02:58,568 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testEmptyExportFileSystemState/6c9d0c2f633373dab954a6c1770e7bfb/cf, FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testEmptyExportFileSystemState/6c9d0c2f633373dab954a6c1770e7bfb/recovered.edits] 2023-10-01 22:02:58,568 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testEmptyExportFileSystemState/a5e2bcc43caec095b38a33c438caaee7/cf, FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testEmptyExportFileSystemState/a5e2bcc43caec095b38a33c438caaee7/recovered.edits] 2023-10-01 22:02:58,568 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 22:02:58,568 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 22:02:58,568 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:58,568 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:58,568 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 22:02:58,568 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 22:02:58,568 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:58,569 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:58,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-01 22:02:58,573 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testEmptyExportFileSystemState/6c9d0c2f633373dab954a6c1770e7bfb/cf/38524a2a8e9d4e4c8c1d92d6497ed55b to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testEmptyExportFileSystemState/6c9d0c2f633373dab954a6c1770e7bfb/cf/38524a2a8e9d4e4c8c1d92d6497ed55b 2023-10-01 22:02:58,573 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testEmptyExportFileSystemState/a5e2bcc43caec095b38a33c438caaee7/cf/b3426cfa2a554d62b4139941c0a50e2b to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testEmptyExportFileSystemState/a5e2bcc43caec095b38a33c438caaee7/cf/b3426cfa2a554d62b4139941c0a50e2b 2023-10-01 22:02:58,577 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testEmptyExportFileSystemState/6c9d0c2f633373dab954a6c1770e7bfb/recovered.edits/9.seqid to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testEmptyExportFileSystemState/6c9d0c2f633373dab954a6c1770e7bfb/recovered.edits/9.seqid 2023-10-01 22:02:58,577 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testEmptyExportFileSystemState/a5e2bcc43caec095b38a33c438caaee7/recovered.edits/9.seqid to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testEmptyExportFileSystemState/a5e2bcc43caec095b38a33c438caaee7/recovered.edits/9.seqid 2023-10-01 22:02:58,577 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testEmptyExportFileSystemState/6c9d0c2f633373dab954a6c1770e7bfb 2023-10-01 22:02:58,577 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testEmptyExportFileSystemState/a5e2bcc43caec095b38a33c438caaee7 2023-10-01 22:02:58,577 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-01 22:02:58,578 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-01 22:02:58,578 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-10-01 22:02:58,582 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231001fc440d7f813549bba12d156a27fea7e4 to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231001fc440d7f813549bba12d156a27fea7e4 2023-10-01 22:02:58,583 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310017cfcf51896754f6f8538c905045cb436 to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310017cfcf51896754f6f8538c905045cb436 2023-10-01 22:02:58,583 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-01 22:02:58,585 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 22:02:58,587 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-10-01 22:02:58,589 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-10-01 22:02:58,590 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 22:02:58,590 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-10-01 22:02:58,590 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696197778590"}]},"ts":"9223372036854775807"} 2023-10-01 22:02:58,590 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696197778590"}]},"ts":"9223372036854775807"} 2023-10-01 22:02:58,592 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-01 22:02:58,592 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6c9d0c2f633373dab954a6c1770e7bfb, NAME => 'testtb-testEmptyExportFileSystemState,,1696197768239.6c9d0c2f633373dab954a6c1770e7bfb.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a5e2bcc43caec095b38a33c438caaee7, NAME => 'testtb-testEmptyExportFileSystemState,1,1696197768239.a5e2bcc43caec095b38a33c438caaee7.', STARTKEY => '1', ENDKEY => ''}] 2023-10-01 22:02:58,592 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-10-01 22:02:58,592 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696197778592"}]},"ts":"9223372036854775807"} 2023-10-01 22:02:58,593 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-10-01 22:02:58,595 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 22:02:58,596 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 36 msec 2023-10-01 22:02:58,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-01 22:02:58,670 INFO [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-10-01 22:02:58,676 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-10-01 22:02:58,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:58,679 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-10-01 22:02:58,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-10-01 22:02:58,703 INFO [Listener at jenkins-hbase4.apache.org/45715] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 757) Potentially hanging thread: hconnection-0x6cc451db-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6cc451db-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:44221 from appattempt_1696197687246_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x6cc451db-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_837599924_1 at /127.0.0.1:51996 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:41567 from appattempt_1696197687246_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1693241814_17 at /127.0.0.1:45434 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1693241814_17 at /127.0.0.1:37528 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1693241814_17 at /127.0.0.1:52022 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:46817 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x6cc451db-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4605 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_837599924_1 at /127.0.0.1:45414 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=944 (was 912) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=146 (was 173), ProcessCount=168 (was 168), AvailableMemoryMB=1265 (was 1296) 2023-10-01 22:02:58,703 WARN [Listener at jenkins-hbase4.apache.org/45715] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-01 22:02:58,722 INFO [Listener at jenkins-hbase4.apache.org/45715] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=944, MaxFileDescriptor=60000, SystemLoadAverage=146, ProcessCount=168, AvailableMemoryMB=1265 2023-10-01 22:02:58,722 WARN [Listener at jenkins-hbase4.apache.org/45715] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-01 22:02:58,724 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-01 22:02:58,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:58,726 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 22:02:58,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-10-01 22:02:58,727 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 22:02:58,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-01 22:02:58,729 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e137c6b849b51dec99c120b3a0e80e96 2023-10-01 22:02:58,729 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c5005b722d599b0355fd7a31d81b6803 2023-10-01 22:02:58,729 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e137c6b849b51dec99c120b3a0e80e96 empty. 2023-10-01 22:02:58,729 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c5005b722d599b0355fd7a31d81b6803 empty. 2023-10-01 22:02:58,730 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e137c6b849b51dec99c120b3a0e80e96 2023-10-01 22:02:58,730 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c5005b722d599b0355fd7a31d81b6803 2023-10-01 22:02:58,730 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-01 22:02:58,739 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-10-01 22:02:58,740 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => e137c6b849b51dec99c120b3a0e80e96, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp 2023-10-01 22:02:58,740 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => c5005b722d599b0355fd7a31d81b6803, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp 2023-10-01 22:02:58,757 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:02:58,757 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing e137c6b849b51dec99c120b3a0e80e96, disabling compactions & flushes 2023-10-01 22:02:58,757 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96. 2023-10-01 22:02:58,757 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96. 2023-10-01 22:02:58,757 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96. after waiting 0 ms 2023-10-01 22:02:58,757 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96. 2023-10-01 22:02:58,757 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96. 2023-10-01 22:02:58,757 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for e137c6b849b51dec99c120b3a0e80e96: 2023-10-01 22:02:58,759 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:02:58,759 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing c5005b722d599b0355fd7a31d81b6803, disabling compactions & flushes 2023-10-01 22:02:58,759 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803. 2023-10-01 22:02:58,759 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803. 2023-10-01 22:02:58,759 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803. after waiting 0 ms 2023-10-01 22:02:58,759 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803. 2023-10-01 22:02:58,759 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803. 2023-10-01 22:02:58,759 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for c5005b722d599b0355fd7a31d81b6803: 2023-10-01 22:02:58,761 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 22:02:58,762 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696197778762"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696197778762"}]},"ts":"1696197778762"} 2023-10-01 22:02:58,762 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696197778762"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696197778762"}]},"ts":"1696197778762"} 2023-10-01 22:02:58,764 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 22:02:58,765 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 22:02:58,765 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696197778765"}]},"ts":"1696197778765"} 2023-10-01 22:02:58,766 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-10-01 22:02:58,770 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 22:02:58,771 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 22:02:58,771 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 22:02:58,771 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 22:02:58,771 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 22:02:58,771 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e137c6b849b51dec99c120b3a0e80e96, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c5005b722d599b0355fd7a31d81b6803, ASSIGN}] 2023-10-01 22:02:58,773 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c5005b722d599b0355fd7a31d81b6803, ASSIGN 2023-10-01 22:02:58,773 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e137c6b849b51dec99c120b3a0e80e96, ASSIGN 2023-10-01 22:02:58,774 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c5005b722d599b0355fd7a31d81b6803, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39235,1696197680862; forceNewPlan=false, retain=false 2023-10-01 22:02:58,774 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e137c6b849b51dec99c120b3a0e80e96, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37145,1696197680825; forceNewPlan=false, retain=false 2023-10-01 22:02:58,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-01 22:02:58,924 INFO [jenkins-hbase4:40311] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 22:02:58,927 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=c5005b722d599b0355fd7a31d81b6803, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:58,927 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=e137c6b849b51dec99c120b3a0e80e96, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:58,927 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696197778927"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696197778927"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696197778927"}]},"ts":"1696197778927"} 2023-10-01 22:02:58,927 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696197778927"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696197778927"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696197778927"}]},"ts":"1696197778927"} 2023-10-01 22:02:58,929 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure c5005b722d599b0355fd7a31d81b6803, server=jenkins-hbase4.apache.org,39235,1696197680862}] 2023-10-01 22:02:58,929 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure e137c6b849b51dec99c120b3a0e80e96, server=jenkins-hbase4.apache.org,37145,1696197680825}] 2023-10-01 22:02:59,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-01 22:02:59,083 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96. 2023-10-01 22:02:59,083 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803. 2023-10-01 22:02:59,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e137c6b849b51dec99c120b3a0e80e96, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96.', STARTKEY => '', ENDKEY => '1'} 2023-10-01 22:02:59,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c5005b722d599b0355fd7a31d81b6803, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803.', STARTKEY => '1', ENDKEY => ''} 2023-10-01 22:02:59,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96. service=AccessControlService 2023-10-01 22:02:59,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803. service=AccessControlService 2023-10-01 22:02:59,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 22:02:59,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 22:02:59,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp e137c6b849b51dec99c120b3a0e80e96 2023-10-01 22:02:59,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp c5005b722d599b0355fd7a31d81b6803 2023-10-01 22:02:59,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:02:59,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 22:02:59,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e137c6b849b51dec99c120b3a0e80e96 2023-10-01 22:02:59,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c5005b722d599b0355fd7a31d81b6803 2023-10-01 22:02:59,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e137c6b849b51dec99c120b3a0e80e96 2023-10-01 22:02:59,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c5005b722d599b0355fd7a31d81b6803 2023-10-01 22:02:59,085 INFO [StoreOpener-c5005b722d599b0355fd7a31d81b6803-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c5005b722d599b0355fd7a31d81b6803 2023-10-01 22:02:59,085 INFO [StoreOpener-e137c6b849b51dec99c120b3a0e80e96-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e137c6b849b51dec99c120b3a0e80e96 2023-10-01 22:02:59,087 DEBUG [StoreOpener-c5005b722d599b0355fd7a31d81b6803-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithSkipTmp/c5005b722d599b0355fd7a31d81b6803/cf 2023-10-01 22:02:59,087 DEBUG [StoreOpener-c5005b722d599b0355fd7a31d81b6803-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithSkipTmp/c5005b722d599b0355fd7a31d81b6803/cf 2023-10-01 22:02:59,087 DEBUG [StoreOpener-e137c6b849b51dec99c120b3a0e80e96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithSkipTmp/e137c6b849b51dec99c120b3a0e80e96/cf 2023-10-01 22:02:59,087 DEBUG [StoreOpener-e137c6b849b51dec99c120b3a0e80e96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithSkipTmp/e137c6b849b51dec99c120b3a0e80e96/cf 2023-10-01 22:02:59,087 INFO [StoreOpener-c5005b722d599b0355fd7a31d81b6803-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c5005b722d599b0355fd7a31d81b6803 columnFamilyName cf 2023-10-01 22:02:59,087 INFO [StoreOpener-e137c6b849b51dec99c120b3a0e80e96-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e137c6b849b51dec99c120b3a0e80e96 columnFamilyName cf 2023-10-01 22:02:59,088 INFO [StoreOpener-e137c6b849b51dec99c120b3a0e80e96-1] regionserver.HStore(310): Store=e137c6b849b51dec99c120b3a0e80e96/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 22:02:59,088 INFO [StoreOpener-c5005b722d599b0355fd7a31d81b6803-1] regionserver.HStore(310): Store=c5005b722d599b0355fd7a31d81b6803/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 22:02:59,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithSkipTmp/e137c6b849b51dec99c120b3a0e80e96 2023-10-01 22:02:59,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithSkipTmp/c5005b722d599b0355fd7a31d81b6803 2023-10-01 22:02:59,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithSkipTmp/e137c6b849b51dec99c120b3a0e80e96 2023-10-01 22:02:59,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithSkipTmp/c5005b722d599b0355fd7a31d81b6803 2023-10-01 22:02:59,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e137c6b849b51dec99c120b3a0e80e96 2023-10-01 22:02:59,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c5005b722d599b0355fd7a31d81b6803 2023-10-01 22:02:59,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithSkipTmp/e137c6b849b51dec99c120b3a0e80e96/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 22:02:59,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithSkipTmp/c5005b722d599b0355fd7a31d81b6803/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 22:02:59,095 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e137c6b849b51dec99c120b3a0e80e96; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70504381, jitterRate=0.05059714615345001}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 22:02:59,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e137c6b849b51dec99c120b3a0e80e96: 2023-10-01 22:02:59,095 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c5005b722d599b0355fd7a31d81b6803; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59663596, jitterRate=-0.11094313859939575}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 22:02:59,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c5005b722d599b0355fd7a31d81b6803: 2023-10-01 22:02:59,096 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96., pid=109, masterSystemTime=1696197779080 2023-10-01 22:02:59,096 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803., pid=108, masterSystemTime=1696197779080 2023-10-01 22:02:59,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96. 2023-10-01 22:02:59,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96. 2023-10-01 22:02:59,097 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=e137c6b849b51dec99c120b3a0e80e96, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803. 2023-10-01 22:02:59,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803. 2023-10-01 22:02:59,098 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696197779097"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696197779097"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696197779097"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696197779097"}]},"ts":"1696197779097"} 2023-10-01 22:02:59,098 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=c5005b722d599b0355fd7a31d81b6803, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,098 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696197779098"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696197779098"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696197779098"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696197779098"}]},"ts":"1696197779098"} 2023-10-01 22:02:59,101 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-10-01 22:02:59,101 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure e137c6b849b51dec99c120b3a0e80e96, server=jenkins-hbase4.apache.org,37145,1696197680825 in 170 msec 2023-10-01 22:02:59,102 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=107 2023-10-01 22:02:59,102 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure c5005b722d599b0355fd7a31d81b6803, server=jenkins-hbase4.apache.org,39235,1696197680862 in 172 msec 2023-10-01 22:02:59,102 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e137c6b849b51dec99c120b3a0e80e96, ASSIGN in 330 msec 2023-10-01 22:02:59,103 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-10-01 22:02:59,103 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c5005b722d599b0355fd7a31d81b6803, ASSIGN in 331 msec 2023-10-01 22:02:59,104 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 22:02:59,104 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696197779104"}]},"ts":"1696197779104"} 2023-10-01 22:02:59,105 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-10-01 22:02:59,107 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 22:02:59,107 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-10-01 22:02:59,109 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37145] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-01 22:02:59,110 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:59,110 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:59,110 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:59,110 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:02:59,112 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-01 22:02:59,112 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-01 22:02:59,112 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-01 22:02:59,112 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-01 22:02:59,113 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 387 msec 2023-10-01 22:02:59,200 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-10-01 22:02:59,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-01 22:02:59,330 INFO [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-10-01 22:02:59,332 DEBUG [Listener at jenkins-hbase4.apache.org/45715] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,332 DEBUG [Listener at jenkins-hbase4.apache.org/45715] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96. 2023-10-01 22:02:59,334 INFO [Listener at jenkins-hbase4.apache.org/45715] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 22:02:59,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-01 22:02:59,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696197779344 (current time:1696197779344). 2023-10-01 22:02:59,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 22:02:59,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(139): Connect 0x7acc2f44 to 127.0.0.1:58905 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 22:02:59,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4cd074f5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 22:02:59,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:02:59,356 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59230, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:02:59,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7acc2f44 to 127.0.0.1:58905 2023-10-01 22:02:59,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:02:59,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(139): Connect 0x1110f4b2 to 127.0.0.1:58905 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 22:02:59,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a3d4fdb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 22:02:59,363 DEBUG [hconnection-0x4585f5b5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:02:59,365 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59238, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:02:59,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:02:59,371 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60936, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:02:59,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1110f4b2 to 127.0.0.1:58905 2023-10-01 22:02:59,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:02:59,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-01 22:02:59,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 22:02:59,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-01 22:02:59,375 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot, current working dir path: hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 22:02:59,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-01 22:02:59,377 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-01 22:02:59,378 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696198379378 2023-10-01 22:02:59,378 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-01 22:02:59,379 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 22:02:59,379 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 22:02:59,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-01 22:02:59,380 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-01 22:02:59,381 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-10-01 22:02:59,381 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-01 22:02:59,382 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696198379382 2023-10-01 22:02:59,390 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,390 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-01 22:02:59,390 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:59,391 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-01 22:02:59,391 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-01 22:02:59,392 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,392 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,393 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:59,393 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:59,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:59,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:59,393 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,393 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:59,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:59,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:59,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:59,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:59,394 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,394 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,394 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,394 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 22:02:59,394 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,395 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,395 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-01 22:02:59,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-01 22:02:59,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-01 22:02:59,395 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-01 22:02:59,395 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-01 22:02:59,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,395 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-01 22:02:59,395 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,395 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,395 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-01 22:02:59,395 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-01 22:02:59,395 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,395 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:59,396 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-01 22:02:59,396 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:59,395 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:59,398 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-01 22:02:59,398 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-01 22:02:59,398 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-01 22:02:59,397 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-01 22:02:59,398 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-01 22:02:59,398 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42263,1696197680774' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-01 22:02:59,398 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-01 22:02:59,399 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37145,1696197680825' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-01 22:02:59,399 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39235,1696197680862' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-01 22:02:59,406 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,406 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,406 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:59,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:59,406 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,406 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,406 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,407 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:02:59,406 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:02:59,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:59,406 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,407 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,407 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:02:59,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:59,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:59,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:59,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37145,1696197680825' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-01 22:02:59,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@440c6531[Count = 1] remaining members to acquire global barrier 2023-10-01 22:02:59,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:59,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:59,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:59,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:59,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:59,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:59,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39235,1696197680862' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-01 22:02:59,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@440c6531[Count = 0] remaining members to acquire global barrier 2023-10-01 22:02:59,410 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-01 22:02:59,410 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,411 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,411 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,411 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,411 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,411 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-01 22:02:59,411 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-01 22:02:59,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,411 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-01 22:02:59,411 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42263,1696197680774' in zk 2023-10-01 22:02:59,411 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-01 22:02:59,412 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,412 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 22:02:59,412 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 22:02:59,412 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 22:02:59,412 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803. 2023-10-01 22:02:59,412 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 22:02:59,412 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 22:02:59,412 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803. started... 2023-10-01 22:02:59,412 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96. 2023-10-01 22:02:59,412 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96. started... 2023-10-01 22:02:59,413 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c5005b722d599b0355fd7a31d81b6803: 2023-10-01 22:02:59,413 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e137c6b849b51dec99c120b3a0e80e96: 2023-10-01 22:02:59,413 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-01 22:02:59,413 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:59,413 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,413 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,413 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-01 22:02:59,413 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 22:02:59,413 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 22:02:59,413 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 22:02:59,414 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 22:02:59,432 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96. completed. 2023-10-01 22:02:59,432 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96. 2023-10-01 22:02:59,432 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 22:02:59,432 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803. completed. 2023-10-01 22:02:59,432 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803. 2023-10-01 22:02:59,432 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 22:02:59,432 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 22:02:59,432 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 22:02:59,432 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,432 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,432 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-01 22:02:59,432 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-01 22:02:59,432 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37145,1696197680825' in zk 2023-10-01 22:02:59,432 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39235,1696197680862' in zk 2023-10-01 22:02:59,440 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-01 22:02:59,440 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,440 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:59,440 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,440 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-01 22:02:59,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,441 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:59,440 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-01 22:02:59,441 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-01 22:02:59,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:59,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:59,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:59,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:59,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:59,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:59,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:59,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39235,1696197680862': 2023-10-01 22:02:59,446 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39235,1696197680862' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-01 22:02:59,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:59,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:59,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:59,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:59,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:59,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:59,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:59,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37145,1696197680825': 2023-10-01 22:02:59,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37145,1696197680825' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-01 22:02:59,449 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-01 22:02:59,449 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 22:02:59,449 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 22:02:59,449 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,449 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 22:02:59,450 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,450 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,450 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:59,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:59,450 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:59,450 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:59,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,450 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,451 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:59,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:59,451 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:59,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:59,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:59,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:59,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:59,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:59,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:59,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,452 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:59,452 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:59,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:59,453 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:59,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,454 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:59,454 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,456 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,457 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,457 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,457 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:59,457 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:59,457 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:59,457 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:59,457 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:59,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:59,457 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:59,457 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:59,457 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,457 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:59,457 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:59,457 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:59,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:59,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:59,457 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,457 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:59,460 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:59,457 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 22:02:59,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:59,460 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:59,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:59,460 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:59,460 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,460 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:59,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:59,461 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-01 22:02:59,470 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,479 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 22:02:59,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-01 22:02:59,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-01 22:02:59,480 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 22:02:59,487 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,487 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-01 22:02:59,487 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,488 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,488 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696197779378Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696197779470 (+92 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696197779470Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696197779470Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696197779473 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696197779480 (+7 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696197779487 (+7 ms) 2023-10-01 22:02:59,490 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-01 22:02:59,492 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 111 msec 2023-10-01 22:02:59,681 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 22:02:59,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-01 22:02:59,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 22:02:59,683 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37145] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 22:02:59,684 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39235] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 22:02:59,687 DEBUG [Listener at jenkins-hbase4.apache.org/45715] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,687 DEBUG [Listener at jenkins-hbase4.apache.org/45715] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96. 2023-10-01 22:02:59,687 INFO [Listener at jenkins-hbase4.apache.org/45715] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 22:02:59,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-01 22:02:59,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696197779695 (current time:1696197779695). 2023-10-01 22:02:59,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 22:02:59,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(139): Connect 0x7d6f2585 to 127.0.0.1:58905 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 22:02:59,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46a95fec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 22:02:59,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:02:59,704 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59242, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:02:59,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d6f2585 to 127.0.0.1:58905 2023-10-01 22:02:59,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:02:59,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(139): Connect 0x3f99a791 to 127.0.0.1:58905 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 22:02:59,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3bdeeeea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 22:02:59,712 DEBUG [hconnection-0x37848042-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:02:59,714 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59258, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:02:59,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 22:02:59,724 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60950, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 22:02:59,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f99a791 to 127.0.0.1:58905 2023-10-01 22:02:59,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:02:59,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-01 22:02:59,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 22:02:59,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-01 22:02:59,729 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot, current working dir path: hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 22:02:59,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-01 22:02:59,731 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-01 22:02:59,732 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696198379732 2023-10-01 22:02:59,732 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-01 22:02:59,733 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 22:02:59,733 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 22:02:59,733 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-01 22:02:59,734 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-01 22:02:59,735 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-10-01 22:02:59,736 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-01 22:02:59,736 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696198379736 2023-10-01 22:02:59,749 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,749 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-01 22:02:59,749 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:59,751 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-01 22:02:59,751 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-01 22:02:59,751 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,751 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,752 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:59,752 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:59,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:59,752 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:59,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:59,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:59,752 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:59,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:59,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:59,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,753 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,753 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,753 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,754 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,754 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,754 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,754 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 22:02:59,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-01 22:02:59,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-01 22:02:59,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,754 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-01 22:02:59,754 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-01 22:02:59,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-01 22:02:59,754 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,755 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-01 22:02:59,755 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:59,755 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-01 22:02:59,757 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,757 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-01 22:02:59,758 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:59,758 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-01 22:02:59,759 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-01 22:02:59,760 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-01 22:02:59,758 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,760 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42263,1696197680774' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-01 22:02:59,760 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-01 22:02:59,760 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-01 22:02:59,760 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39235,1696197680862' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-01 22:02:59,760 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 22:02:59,761 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-01 22:02:59,761 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-01 22:02:59,761 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37145,1696197680825' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-01 22:02:59,763 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,763 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,763 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:59,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:59,764 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:59,764 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,764 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,764 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,764 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:02:59,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:59,764 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:02:59,764 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,764 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 22:02:59,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:59,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:59,766 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39235,1696197680862' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-01 22:02:59,766 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3165b980[Count = 1] remaining members to acquire global barrier 2023-10-01 22:02:59,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:59,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:59,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:59,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:59,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:59,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:59,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37145,1696197680825' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-01 22:02:59,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3165b980[Count = 0] remaining members to acquire global barrier 2023-10-01 22:02:59,768 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-01 22:02:59,768 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,773 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,773 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,773 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,773 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-01 22:02:59,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,773 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,773 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 22:02:59,773 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 22:02:59,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,773 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96. 2023-10-01 22:02:59,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,774 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96. started... 2023-10-01 22:02:59,774 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,774 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 22:02:59,774 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-01 22:02:59,774 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-01 22:02:59,774 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-01 22:02:59,774 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42263,1696197680774' in zk 2023-10-01 22:02:59,774 INFO [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e137c6b849b51dec99c120b3a0e80e96 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-10-01 22:02:59,774 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803. 2023-10-01 22:02:59,774 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 22:02:59,774 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 22:02:59,774 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803. started... 2023-10-01 22:02:59,774 INFO [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c5005b722d599b0355fd7a31d81b6803 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-10-01 22:02:59,777 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-01 22:02:59,777 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:59,777 DEBUG [member: 'jenkins-hbase4.apache.org,42263,1696197680774' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-01 22:02:59,801 INFO [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231001a785aa5fcca84f12b8034e01423132d7 to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231001a785aa5fcca84f12b8034e01423132d7 2023-10-01 22:02:59,802 INFO [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231001c0722a115ba345b4a4fa4468d459ddca to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20231001c0722a115ba345b4a4fa4468d459ddca 2023-10-01 22:02:59,817 INFO [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithSkipTmp/e137c6b849b51dec99c120b3a0e80e96/.tmp/cf/469e3ea0294f47a1a017bd88f46faa20 2023-10-01 22:02:59,819 INFO [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithSkipTmp/c5005b722d599b0355fd7a31d81b6803/.tmp/cf/0371f91bc53949cdbdb5432d61e0a565 2023-10-01 22:02:59,822 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithSkipTmp/e137c6b849b51dec99c120b3a0e80e96/.tmp/cf/469e3ea0294f47a1a017bd88f46faa20 as hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithSkipTmp/e137c6b849b51dec99c120b3a0e80e96/cf/469e3ea0294f47a1a017bd88f46faa20 2023-10-01 22:02:59,824 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithSkipTmp/c5005b722d599b0355fd7a31d81b6803/.tmp/cf/0371f91bc53949cdbdb5432d61e0a565 as hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithSkipTmp/c5005b722d599b0355fd7a31d81b6803/cf/0371f91bc53949cdbdb5432d61e0a565 2023-10-01 22:02:59,827 INFO [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithSkipTmp/e137c6b849b51dec99c120b3a0e80e96/cf/469e3ea0294f47a1a017bd88f46faa20, entries=6, sequenceid=6, filesize=6.0 K 2023-10-01 22:02:59,828 INFO [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithSkipTmp/c5005b722d599b0355fd7a31d81b6803/cf/0371f91bc53949cdbdb5432d61e0a565, entries=44, sequenceid=6, filesize=12.8 K 2023-10-01 22:02:59,828 INFO [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for e137c6b849b51dec99c120b3a0e80e96 in 54ms, sequenceid=6, compaction requested=false 2023-10-01 22:02:59,829 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e137c6b849b51dec99c120b3a0e80e96: 2023-10-01 22:02:59,830 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,830 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 22:02:59,830 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithSkipTmp/e137c6b849b51dec99c120b3a0e80e96/cf/469e3ea0294f47a1a017bd88f46faa20] hfiles 2023-10-01 22:02:59,830 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithSkipTmp/e137c6b849b51dec99c120b3a0e80e96/cf/469e3ea0294f47a1a017bd88f46faa20 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,830 INFO [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for c5005b722d599b0355fd7a31d81b6803 in 56ms, sequenceid=6, compaction requested=false 2023-10-01 22:02:59,830 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c5005b722d599b0355fd7a31d81b6803: 2023-10-01 22:02:59,830 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,830 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 22:02:59,830 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithSkipTmp/c5005b722d599b0355fd7a31d81b6803/cf/0371f91bc53949cdbdb5432d61e0a565] hfiles 2023-10-01 22:02:59,830 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithSkipTmp/c5005b722d599b0355fd7a31d81b6803/cf/0371f91bc53949cdbdb5432d61e0a565 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,833 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 22:02:59,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-01 22:02:59,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-01 22:02:59,834 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 22:02:59,841 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96. completed. 2023-10-01 22:02:59,841 DEBUG [rs(jenkins-hbase4.apache.org,37145,1696197680825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96. 2023-10-01 22:02:59,841 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 22:02:59,841 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 22:02:59,841 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,841 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-01 22:02:59,841 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37145,1696197680825' in zk 2023-10-01 22:02:59,843 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-01 22:02:59,843 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,843 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:59,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:59,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:59,843 DEBUG [member: 'jenkins-hbase4.apache.org,37145,1696197680825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-01 22:02:59,845 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803. completed. 2023-10-01 22:02:59,845 DEBUG [rs(jenkins-hbase4.apache.org,39235,1696197680862)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803. 2023-10-01 22:02:59,845 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 22:02:59,845 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 22:02:59,845 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,845 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-01 22:02:59,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:59,845 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39235,1696197680862' in zk 2023-10-01 22:02:59,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:59,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,847 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-01 22:02:59,847 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:59,847 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:59,847 DEBUG [member: 'jenkins-hbase4.apache.org,39235,1696197680862' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-01 22:02:59,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:59,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:59,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37145,1696197680825': 2023-10-01 22:02:59,851 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37145,1696197680825' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-01 22:02:59,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:59,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:59,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:59,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:59,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:59,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:59,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:59,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39235,1696197680862': 2023-10-01 22:02:59,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39235,1696197680862' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-01 22:02:59,855 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-01 22:02:59,855 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 22:02:59,855 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 22:02:59,855 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,855 INFO [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 22:02:59,856 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,856 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,856 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:59,856 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:59,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,856 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,856 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 22:02:59,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 22:02:59,857 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:59,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,857 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:59,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 22:02:59,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:59,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:59,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:59,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:59,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:59,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:59,858 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,858 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 22:02:59,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:59,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,860 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:59,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 22:02:59,860 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,860 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:59,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,864 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:59,864 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:59,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:59,864 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 22:02:59,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:59,864 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:59,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:59,865 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:59,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 22:02:59,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:59,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 22:02:59,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:59,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:59,865 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 22:02:59,865 DEBUG [(jenkins-hbase4.apache.org,40311,1696197679483)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 22:02:59,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:59,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:59,865 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,865 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 22:02:59,867 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 22:02:59,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,867 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 22:02:59,867 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,867 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:59,867 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,867 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:02:59,867 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,867 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:02:59,867 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:02:59,868 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,868 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20231001c0722a115ba345b4a4fa4468d459ddca, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231001a785aa5fcca84f12b8034e01423132d7] mob files 2023-10-01 22:02:59,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20231001c0722a115ba345b4a4fa4468d459ddca 2023-10-01 22:02:59,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231001a785aa5fcca84f12b8034e01423132d7 2023-10-01 22:02:59,879 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,879 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,900 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,901 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-01 22:02:59,901 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,902 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:02:59,902 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696197779732Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696197779879 (+147 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696197779879Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1696197779879Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1696197779882 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696197779894 (+12 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696197779901 (+7 ms) 2023-10-01 22:02:59,904 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-01 22:02:59,906 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 171 msec 2023-10-01 22:03:00,034 DEBUG [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 22:03:00,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-01 22:03:00,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 22:03:00,036 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197780036 2023-10-01 22:03:00,036 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36919, tgtDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197780036, rawTgtDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197780036, srcFsUri=hdfs://localhost:36919, srcDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9 2023-10-01 22:03:00,059 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36919, inputRoot=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9 2023-10-01 22:03:00,059 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-587749672_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197780036, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197780036/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:03:00,059 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36919, inputRoot=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9, snapshotDir=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-10-01 22:03:00,066 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197780036/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:03:00,080 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 22:03:00,081 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 22:03:00,081 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 22:03:00,081 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 22:03:00,954 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/hadoop-8496025994758463300.jar 2023-10-01 22:03:00,955 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 22:03:00,955 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 22:03:01,021 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/hadoop-775613864962025778.jar 2023-10-01 22:03:01,022 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 22:03:01,022 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 22:03:01,023 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 22:03:01,023 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 22:03:01,023 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 22:03:01,024 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 22:03:01,024 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 22:03:01,024 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 22:03:01,025 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 22:03:01,025 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 22:03:01,025 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 22:03:01,026 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 22:03:01,026 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 22:03:01,026 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 22:03:01,027 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 22:03:01,027 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 22:03:01,028 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 22:03:01,028 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 22:03:01,029 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 22:03:01,029 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 22:03:01,029 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 22:03:01,029 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 22:03:01,030 DEBUG [Listener at jenkins-hbase4.apache.org/45715] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 22:03:01,358 WARN [Listener at jenkins-hbase4.apache.org/45715] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 22:03:01,360 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-10-01 22:03:01,362 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-10-01 22:03:03,300 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 22:03:03,300 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 22:03:03,303 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696197687246_0006_000001 (auth:SIMPLE) 2023-10-01 22:03:03,613 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696197687246_0007_000001 (auth:SIMPLE) 2023-10-01 22:03:04,008 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 22:03:07,284 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696197687246_0007_000001 (auth:SIMPLE) 2023-10-01 22:03:09,489 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696197687246_0007_000001 (auth:SIMPLE) 2023-10-01 22:03:11,949 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696197687246_0007_000001 (auth:SIMPLE) 2023-10-01 22:03:13,515 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 22:03:13,515 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 22:03:13,525 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:03:13,525 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 22:03:13,526 INFO [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 22:03:13,526 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1693241814_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:03:13,526 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(367): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-01 22:03:13,527 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(367): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-01 22:03:13,527 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1693241814_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197780036/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197780036/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:03:13,527 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(367): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197780036/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-01 22:03:13,527 DEBUG [Listener at jenkins-hbase4.apache.org/45715] snapshot.TestExportSnapshot(367): hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/export-test/export-1696197780036/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-01 22:03:13,532 INFO [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 22:03:13,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 22:03:13,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 22:03:13,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-01 22:03:13,536 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696197793536"}]},"ts":"1696197793536"} 2023-10-01 22:03:13,537 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-10-01 22:03:13,539 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-10-01 22:03:13,539 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e137c6b849b51dec99c120b3a0e80e96, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c5005b722d599b0355fd7a31d81b6803, UNASSIGN}] 2023-10-01 22:03:13,541 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e137c6b849b51dec99c120b3a0e80e96, UNASSIGN 2023-10-01 22:03:13,541 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c5005b722d599b0355fd7a31d81b6803, UNASSIGN 2023-10-01 22:03:13,542 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=e137c6b849b51dec99c120b3a0e80e96, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:03:13,542 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=c5005b722d599b0355fd7a31d81b6803, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:03:13,542 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696197793541"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696197793541"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696197793541"}]},"ts":"1696197793541"} 2023-10-01 22:03:13,542 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696197793541"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696197793541"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696197793541"}]},"ts":"1696197793541"} 2023-10-01 22:03:13,543 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure e137c6b849b51dec99c120b3a0e80e96, server=jenkins-hbase4.apache.org,37145,1696197680825}] 2023-10-01 22:03:13,544 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure c5005b722d599b0355fd7a31d81b6803, server=jenkins-hbase4.apache.org,39235,1696197680862}] 2023-10-01 22:03:13,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-01 22:03:13,695 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e137c6b849b51dec99c120b3a0e80e96 2023-10-01 22:03:13,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e137c6b849b51dec99c120b3a0e80e96, disabling compactions & flushes 2023-10-01 22:03:13,695 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96. 2023-10-01 22:03:13,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96. 2023-10-01 22:03:13,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96. after waiting 0 ms 2023-10-01 22:03:13,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96. 2023-10-01 22:03:13,699 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c5005b722d599b0355fd7a31d81b6803 2023-10-01 22:03:13,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c5005b722d599b0355fd7a31d81b6803, disabling compactions & flushes 2023-10-01 22:03:13,699 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803. 2023-10-01 22:03:13,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803. 2023-10-01 22:03:13,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803. after waiting 0 ms 2023-10-01 22:03:13,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803. 2023-10-01 22:03:13,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithSkipTmp/e137c6b849b51dec99c120b3a0e80e96/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 22:03:13,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 22:03:13,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96. 2023-10-01 22:03:13,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e137c6b849b51dec99c120b3a0e80e96: 2023-10-01 22:03:13,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/default/testtb-testExportFileSystemStateWithSkipTmp/c5005b722d599b0355fd7a31d81b6803/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 22:03:13,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 22:03:13,710 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803. 2023-10-01 22:03:13,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c5005b722d599b0355fd7a31d81b6803: 2023-10-01 22:03:13,711 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e137c6b849b51dec99c120b3a0e80e96 2023-10-01 22:03:13,711 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=e137c6b849b51dec99c120b3a0e80e96, regionState=CLOSED 2023-10-01 22:03:13,711 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c5005b722d599b0355fd7a31d81b6803 2023-10-01 22:03:13,711 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696197793711"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696197793711"}]},"ts":"1696197793711"} 2023-10-01 22:03:13,711 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=c5005b722d599b0355fd7a31d81b6803, regionState=CLOSED 2023-10-01 22:03:13,712 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696197793711"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696197793711"}]},"ts":"1696197793711"} 2023-10-01 22:03:13,714 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-10-01 22:03:13,714 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure e137c6b849b51dec99c120b3a0e80e96, server=jenkins-hbase4.apache.org,37145,1696197680825 in 169 msec 2023-10-01 22:03:13,715 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-10-01 22:03:13,715 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure c5005b722d599b0355fd7a31d81b6803, server=jenkins-hbase4.apache.org,39235,1696197680862 in 169 msec 2023-10-01 22:03:13,715 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e137c6b849b51dec99c120b3a0e80e96, UNASSIGN in 175 msec 2023-10-01 22:03:13,716 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-10-01 22:03:13,716 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c5005b722d599b0355fd7a31d81b6803, UNASSIGN in 176 msec 2023-10-01 22:03:13,717 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696197793717"}]},"ts":"1696197793717"} 2023-10-01 22:03:13,718 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-10-01 22:03:13,719 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-10-01 22:03:13,720 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 187 msec 2023-10-01 22:03:13,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-01 22:03:13,838 INFO [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-10-01 22:03:13,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 22:03:13,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 22:03:13,842 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 22:03:13,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 22:03:13,843 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 22:03:13,844 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37145] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 22:03:13,847 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e137c6b849b51dec99c120b3a0e80e96 2023-10-01 22:03:13,847 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c5005b722d599b0355fd7a31d81b6803 2023-10-01 22:03:13,847 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 22:03:13,847 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 22:03:13,847 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 22:03:13,847 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 22:03:13,848 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-01 22:03:13,848 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-01 22:03:13,848 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-01 22:03:13,848 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-01 22:03:13,849 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 22:03:13,849 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 22:03:13,849 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:03:13,849 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 22:03:13,849 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e137c6b849b51dec99c120b3a0e80e96/cf, FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e137c6b849b51dec99c120b3a0e80e96/recovered.edits] 2023-10-01 22:03:13,849 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:03:13,849 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:03:13,849 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 22:03:13,849 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 22:03:13,850 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c5005b722d599b0355fd7a31d81b6803/cf, FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c5005b722d599b0355fd7a31d81b6803/recovered.edits] 2023-10-01 22:03:13,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-01 22:03:13,853 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c5005b722d599b0355fd7a31d81b6803/cf/0371f91bc53949cdbdb5432d61e0a565 to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/c5005b722d599b0355fd7a31d81b6803/cf/0371f91bc53949cdbdb5432d61e0a565 2023-10-01 22:03:13,853 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e137c6b849b51dec99c120b3a0e80e96/cf/469e3ea0294f47a1a017bd88f46faa20 to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e137c6b849b51dec99c120b3a0e80e96/cf/469e3ea0294f47a1a017bd88f46faa20 2023-10-01 22:03:13,856 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c5005b722d599b0355fd7a31d81b6803/recovered.edits/9.seqid to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/c5005b722d599b0355fd7a31d81b6803/recovered.edits/9.seqid 2023-10-01 22:03:13,856 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e137c6b849b51dec99c120b3a0e80e96/recovered.edits/9.seqid to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e137c6b849b51dec99c120b3a0e80e96/recovered.edits/9.seqid 2023-10-01 22:03:13,857 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c5005b722d599b0355fd7a31d81b6803 2023-10-01 22:03:13,857 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e137c6b849b51dec99c120b3a0e80e96 2023-10-01 22:03:13,857 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-01 22:03:13,857 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-01 22:03:13,858 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-10-01 22:03:13,862 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20231001c0722a115ba345b4a4fa4468d459ddca to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20231001c0722a115ba345b4a4fa4468d459ddca 2023-10-01 22:03:13,863 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231001a785aa5fcca84f12b8034e01423132d7 to hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231001a785aa5fcca84f12b8034e01423132d7 2023-10-01 22:03:13,864 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-01 22:03:13,866 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 22:03:13,868 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-10-01 22:03:13,870 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-10-01 22:03:13,871 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 22:03:13,871 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-10-01 22:03:13,871 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696197793871"}]},"ts":"9223372036854775807"} 2023-10-01 22:03:13,871 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696197793871"}]},"ts":"9223372036854775807"} 2023-10-01 22:03:13,873 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-01 22:03:13,873 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e137c6b849b51dec99c120b3a0e80e96, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696197778723.e137c6b849b51dec99c120b3a0e80e96.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c5005b722d599b0355fd7a31d81b6803, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696197778723.c5005b722d599b0355fd7a31d81b6803.', STARTKEY => '1', ENDKEY => ''}] 2023-10-01 22:03:13,873 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-10-01 22:03:13,873 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696197793873"}]},"ts":"9223372036854775807"} 2023-10-01 22:03:13,875 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-10-01 22:03:13,876 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 22:03:13,877 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 37 msec 2023-10-01 22:03:13,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-01 22:03:13,951 INFO [Listener at jenkins-hbase4.apache.org/45715] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-10-01 22:03:13,958 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-01 22:03:13,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:03:13,961 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-01 22:03:13,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40311] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 22:03:13,987 INFO [Listener at jenkins-hbase4.apache.org/45715] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765 (was 765), OpenFileDescriptor=913 (was 944), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=159 (was 146) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=1179 (was 1265) 2023-10-01 22:03:13,987 WARN [Listener at jenkins-hbase4.apache.org/45715] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-01 22:03:13,987 INFO [Listener at jenkins-hbase4.apache.org/45715] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-10-01 22:03:13,997 INFO [Listener at jenkins-hbase4.apache.org/45715] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-01 22:03:18,122 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696197687246_0007_000001 (auth:SIMPLE) 2023-10-01 22:03:19,278 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 22:03:28,122 INFO [Listener at jenkins-hbase4.apache.org/45715] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-01 22:03:42,238 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-01 22:03:42,239 INFO [Listener at jenkins-hbase4.apache.org/45715] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-01 22:03:42,347 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-10-01 22:03:42,358 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-10-01 22:03:42,359 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-01 22:03:42,368 INFO [Listener at jenkins-hbase4.apache.org/45715] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-01 22:03:42,472 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-01 22:03:42,472 INFO [Listener at jenkins-hbase4.apache.org/45715] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-10-01 22:03:42,472 INFO [Listener at jenkins-hbase4.apache.org/45715] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-10-01 22:03:42,472 INFO [Listener at jenkins-hbase4.apache.org/45715] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-01 22:03:42,472 DEBUG [Listener at jenkins-hbase4.apache.org/45715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f3f5cbd to 127.0.0.1:58905 2023-10-01 22:03:42,472 DEBUG [Listener at jenkins-hbase4.apache.org/45715] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:03:42,473 DEBUG [Listener at jenkins-hbase4.apache.org/45715] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-10-01 22:03:42,473 DEBUG [Listener at jenkins-hbase4.apache.org/45715] util.JVMClusterUtil(257): Found active master hash=704190271, stopped=false 2023-10-01 22:03:42,473 DEBUG [Listener at jenkins-hbase4.apache.org/45715] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 22:03:42,473 DEBUG [Listener at jenkins-hbase4.apache.org/45715] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-01 22:03:42,473 INFO [Listener at jenkins-hbase4.apache.org/45715] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40311,1696197679483 2023-10-01 22:03:42,474 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-01 22:03:42,474 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-01 22:03:42,474 INFO [Listener at jenkins-hbase4.apache.org/45715] procedure2.ProcedureExecutor(628): Stopping 2023-10-01 22:03:42,474 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-01 22:03:42,474 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-01 22:03:42,475 DEBUG [Listener at jenkins-hbase4.apache.org/45715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x427467e0 to 127.0.0.1:58905 2023-10-01 22:03:42,475 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 22:03:42,475 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 22:03:42,475 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 22:03:42,475 DEBUG [Listener at jenkins-hbase4.apache.org/45715] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:03:42,475 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 22:03:42,475 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 22:03:42,475 INFO [Listener at jenkins-hbase4.apache.org/45715] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42263,1696197680774' ***** 2023-10-01 22:03:42,476 DEBUG [Listener at jenkins-hbase4.apache.org/45715] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 22:03:42,476 INFO [Listener at jenkins-hbase4.apache.org/45715] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-01 22:03:42,476 INFO [Listener at jenkins-hbase4.apache.org/45715] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37145,1696197680825' ***** 2023-10-01 22:03:42,476 DEBUG [Listener at jenkins-hbase4.apache.org/45715] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 22:03:42,476 INFO [Listener at jenkins-hbase4.apache.org/45715] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-01 22:03:42,476 INFO [RS:0;jenkins-hbase4:42263] regionserver.HeapMemoryManager(220): Stopping 2023-10-01 22:03:42,476 INFO [Listener at jenkins-hbase4.apache.org/45715] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39235,1696197680862' ***** 2023-10-01 22:03:42,476 INFO [RS:1;jenkins-hbase4:37145] regionserver.HeapMemoryManager(220): Stopping 2023-10-01 22:03:42,476 INFO [RS:0;jenkins-hbase4:42263] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-01 22:03:42,476 INFO [RS:1;jenkins-hbase4:37145] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-01 22:03:42,476 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-01 22:03:42,476 INFO [RS:1;jenkins-hbase4:37145] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-01 22:03:42,476 INFO [RS:0;jenkins-hbase4:42263] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-01 22:03:42,476 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-01 22:03:42,476 INFO [RS:0;jenkins-hbase4:42263] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:03:42,476 DEBUG [Listener at jenkins-hbase4.apache.org/45715] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 22:03:42,476 DEBUG [RS:0;jenkins-hbase4:42263] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x309db57c to 127.0.0.1:58905 2023-10-01 22:03:42,476 INFO [RS:1;jenkins-hbase4:37145] regionserver.HRegionServer(3305): Received CLOSE for 62f2c814ef3efb99d2c6171ce3348ce0 2023-10-01 22:03:42,477 DEBUG [RS:0;jenkins-hbase4:42263] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:03:42,477 INFO [Listener at jenkins-hbase4.apache.org/45715] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-01 22:03:42,479 INFO [RS:0;jenkins-hbase4:42263] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-01 22:03:42,479 INFO [RS:0;jenkins-hbase4:42263] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-01 22:03:42,479 INFO [RS:0;jenkins-hbase4:42263] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-01 22:03:42,479 INFO [RS:1;jenkins-hbase4:37145] regionserver.HRegionServer(3305): Received CLOSE for 4910acaf33428285af586d76cbf2f7ce 2023-10-01 22:03:42,479 INFO [RS:0;jenkins-hbase4:42263] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-10-01 22:03:42,479 INFO [RS:2;jenkins-hbase4:39235] regionserver.HeapMemoryManager(220): Stopping 2023-10-01 22:03:42,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 62f2c814ef3efb99d2c6171ce3348ce0, disabling compactions & flushes 2023-10-01 22:03:42,480 INFO [RS:2;jenkins-hbase4:39235] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-01 22:03:42,479 INFO [RS:1;jenkins-hbase4:37145] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:03:42,480 INFO [RS:2;jenkins-hbase4:39235] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-01 22:03:42,480 INFO [RS:0;jenkins-hbase4:42263] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-10-01 22:03:42,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696197682897.62f2c814ef3efb99d2c6171ce3348ce0. 2023-10-01 22:03:42,480 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-01 22:03:42,480 DEBUG [RS:0;jenkins-hbase4:42263] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-10-01 22:03:42,481 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-01 22:03:42,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696197682897.62f2c814ef3efb99d2c6171ce3348ce0. 2023-10-01 22:03:42,481 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-01 22:03:42,480 INFO [RS:2;jenkins-hbase4:39235] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:03:42,480 DEBUG [RS:1;jenkins-hbase4:37145] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ff98d89 to 127.0.0.1:58905 2023-10-01 22:03:42,481 DEBUG [RS:2;jenkins-hbase4:39235] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f2a1dcd to 127.0.0.1:58905 2023-10-01 22:03:42,481 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-01 22:03:42,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696197682897.62f2c814ef3efb99d2c6171ce3348ce0. after waiting 0 ms 2023-10-01 22:03:42,481 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-01 22:03:42,481 DEBUG [RS:2;jenkins-hbase4:39235] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:03:42,481 DEBUG [RS:1;jenkins-hbase4:37145] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:03:42,482 INFO [RS:2;jenkins-hbase4:39235] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39235,1696197680862; all regions closed. 2023-10-01 22:03:42,481 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-01 22:03:42,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696197682897.62f2c814ef3efb99d2c6171ce3348ce0. 2023-10-01 22:03:42,482 INFO [RS:1;jenkins-hbase4:37145] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-10-01 22:03:42,482 DEBUG [RS:0;jenkins-hbase4:42263] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-10-01 22:03:42,482 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-10-01 22:03:42,482 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 62f2c814ef3efb99d2c6171ce3348ce0 1/1 column families, dataSize=78 B heapSize=488 B 2023-10-01 22:03:42,482 DEBUG [RS:1;jenkins-hbase4:37145] regionserver.HRegionServer(1478): Online Regions={62f2c814ef3efb99d2c6171ce3348ce0=hbase:namespace,,1696197682897.62f2c814ef3efb99d2c6171ce3348ce0., 4910acaf33428285af586d76cbf2f7ce=hbase:acl,,1696197683635.4910acaf33428285af586d76cbf2f7ce.} 2023-10-01 22:03:42,483 DEBUG [RS:1;jenkins-hbase4:37145] regionserver.HRegionServer(1504): Waiting on 4910acaf33428285af586d76cbf2f7ce, 62f2c814ef3efb99d2c6171ce3348ce0 2023-10-01 22:03:42,495 DEBUG [RS:2;jenkins-hbase4:39235] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/oldWALs 2023-10-01 22:03:42,495 INFO [RS:2;jenkins-hbase4:39235] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39235%2C1696197680862:(num 1696197682497) 2023-10-01 22:03:42,495 DEBUG [RS:2;jenkins-hbase4:39235] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:03:42,495 INFO [RS:2;jenkins-hbase4:39235] regionserver.LeaseManager(133): Closed leases 2023-10-01 22:03:42,499 INFO [RS:2;jenkins-hbase4:39235] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-01 22:03:42,499 INFO [RS:2;jenkins-hbase4:39235] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-01 22:03:42,499 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-01 22:03:42,499 INFO [RS:2;jenkins-hbase4:39235] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-01 22:03:42,499 INFO [RS:2;jenkins-hbase4:39235] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-01 22:03:42,501 INFO [RS:2;jenkins-hbase4:39235] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39235 2023-10-01 22:03:42,505 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/namespace/62f2c814ef3efb99d2c6171ce3348ce0/.tmp/info/6ab030b7705d4736bef9d8ec45eae494 2023-10-01 22:03:42,506 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:03:42,506 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:03:42,506 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 22:03:42,506 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39235,1696197680862 2023-10-01 22:03:42,507 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 22:03:42,506 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 22:03:42,506 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 22:03:42,508 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39235,1696197680862] 2023-10-01 22:03:42,514 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/meta/1588230740/.tmp/info/f6cbd0eb186d431ca1e26f47bea282a4 2023-10-01 22:03:42,514 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39235,1696197680862; numProcessing=1 2023-10-01 22:03:42,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/namespace/62f2c814ef3efb99d2c6171ce3348ce0/.tmp/info/6ab030b7705d4736bef9d8ec45eae494 as hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/namespace/62f2c814ef3efb99d2c6171ce3348ce0/info/6ab030b7705d4736bef9d8ec45eae494 2023-10-01 22:03:42,518 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f6cbd0eb186d431ca1e26f47bea282a4 2023-10-01 22:03:42,518 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39235,1696197680862 already deleted, retry=false 2023-10-01 22:03:42,518 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39235,1696197680862 expired; onlineServers=2 2023-10-01 22:03:42,522 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/namespace/62f2c814ef3efb99d2c6171ce3348ce0/info/6ab030b7705d4736bef9d8ec45eae494, entries=2, sequenceid=6, filesize=4.8 K 2023-10-01 22:03:42,523 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 62f2c814ef3efb99d2c6171ce3348ce0 in 41ms, sequenceid=6, compaction requested=false 2023-10-01 22:03:42,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/namespace/62f2c814ef3efb99d2c6171ce3348ce0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 22:03:42,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 22:03:42,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696197682897.62f2c814ef3efb99d2c6171ce3348ce0. 2023-10-01 22:03:42,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 62f2c814ef3efb99d2c6171ce3348ce0: 2023-10-01 22:03:42,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1696197682897.62f2c814ef3efb99d2c6171ce3348ce0. 2023-10-01 22:03:42,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4910acaf33428285af586d76cbf2f7ce, disabling compactions & flushes 2023-10-01 22:03:42,532 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696197683635.4910acaf33428285af586d76cbf2f7ce. 2023-10-01 22:03:42,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696197683635.4910acaf33428285af586d76cbf2f7ce. 2023-10-01 22:03:42,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696197683635.4910acaf33428285af586d76cbf2f7ce. after waiting 0 ms 2023-10-01 22:03:42,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696197683635.4910acaf33428285af586d76cbf2f7ce. 2023-10-01 22:03:42,532 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/meta/1588230740/.tmp/rep_barrier/bb410a23f0c2422199455ddd55f00128 2023-10-01 22:03:42,532 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 4910acaf33428285af586d76cbf2f7ce 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-10-01 22:03:42,536 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bb410a23f0c2422199455ddd55f00128 2023-10-01 22:03:42,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/acl/4910acaf33428285af586d76cbf2f7ce/.tmp/l/f4a6a70159dc4676aa146a56c11fa36f 2023-10-01 22:03:42,548 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/meta/1588230740/.tmp/table/8ef33cbd6c57452597686e6a21361875 2023-10-01 22:03:42,550 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f4a6a70159dc4676aa146a56c11fa36f 2023-10-01 22:03:42,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/acl/4910acaf33428285af586d76cbf2f7ce/.tmp/l/f4a6a70159dc4676aa146a56c11fa36f as hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/acl/4910acaf33428285af586d76cbf2f7ce/l/f4a6a70159dc4676aa146a56c11fa36f 2023-10-01 22:03:42,552 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8ef33cbd6c57452597686e6a21361875 2023-10-01 22:03:42,553 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/meta/1588230740/.tmp/info/f6cbd0eb186d431ca1e26f47bea282a4 as hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/meta/1588230740/info/f6cbd0eb186d431ca1e26f47bea282a4 2023-10-01 22:03:42,554 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f4a6a70159dc4676aa146a56c11fa36f 2023-10-01 22:03:42,555 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/acl/4910acaf33428285af586d76cbf2f7ce/l/f4a6a70159dc4676aa146a56c11fa36f, entries=7, sequenceid=18, filesize=5.2 K 2023-10-01 22:03:42,555 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 4910acaf33428285af586d76cbf2f7ce in 23ms, sequenceid=18, compaction requested=false 2023-10-01 22:03:42,561 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f6cbd0eb186d431ca1e26f47bea282a4 2023-10-01 22:03:42,561 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/meta/1588230740/info/f6cbd0eb186d431ca1e26f47bea282a4, entries=48, sequenceid=131, filesize=10.3 K 2023-10-01 22:03:42,562 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/meta/1588230740/.tmp/rep_barrier/bb410a23f0c2422199455ddd55f00128 as hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/meta/1588230740/rep_barrier/bb410a23f0c2422199455ddd55f00128 2023-10-01 22:03:42,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/acl/4910acaf33428285af586d76cbf2f7ce/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-10-01 22:03:42,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 22:03:42,564 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1696197683635.4910acaf33428285af586d76cbf2f7ce. 2023-10-01 22:03:42,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4910acaf33428285af586d76cbf2f7ce: 2023-10-01 22:03:42,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1696197683635.4910acaf33428285af586d76cbf2f7ce. 2023-10-01 22:03:42,567 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bb410a23f0c2422199455ddd55f00128 2023-10-01 22:03:42,567 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/meta/1588230740/rep_barrier/bb410a23f0c2422199455ddd55f00128, entries=13, sequenceid=131, filesize=6.4 K 2023-10-01 22:03:42,568 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/meta/1588230740/.tmp/table/8ef33cbd6c57452597686e6a21361875 as hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/meta/1588230740/table/8ef33cbd6c57452597686e6a21361875 2023-10-01 22:03:42,569 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-01 22:03:42,569 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-01 22:03:42,571 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-01 22:03:42,572 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8ef33cbd6c57452597686e6a21361875 2023-10-01 22:03:42,572 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/meta/1588230740/table/8ef33cbd6c57452597686e6a21361875, entries=24, sequenceid=131, filesize=6.9 K 2023-10-01 22:03:42,573 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 91ms, sequenceid=131, compaction requested=false 2023-10-01 22:03:42,582 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-10-01 22:03:42,583 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 22:03:42,583 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-01 22:03:42,583 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-01 22:03:42,583 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-01 22:03:42,584 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-10-01 22:03:42,609 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 22:03:42,609 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:39235-0x1010401cd730003, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 22:03:42,609 INFO [RS:2;jenkins-hbase4:39235] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39235,1696197680862; zookeeper connection closed. 2023-10-01 22:03:42,609 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@771143b3] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@771143b3 2023-10-01 22:03:42,682 INFO [RS:0;jenkins-hbase4:42263] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42263,1696197680774; all regions closed. 2023-10-01 22:03:42,683 INFO [RS:1;jenkins-hbase4:37145] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37145,1696197680825; all regions closed. 2023-10-01 22:03:42,690 DEBUG [RS:1;jenkins-hbase4:37145] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/oldWALs 2023-10-01 22:03:42,690 INFO [RS:1;jenkins-hbase4:37145] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37145%2C1696197680825:(num 1696197682497) 2023-10-01 22:03:42,690 DEBUG [RS:0;jenkins-hbase4:42263] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/oldWALs 2023-10-01 22:03:42,690 DEBUG [RS:1;jenkins-hbase4:37145] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:03:42,690 INFO [RS:0;jenkins-hbase4:42263] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42263%2C1696197680774.meta:.meta(num 1696197682623) 2023-10-01 22:03:42,690 INFO [RS:1;jenkins-hbase4:37145] regionserver.LeaseManager(133): Closed leases 2023-10-01 22:03:42,691 INFO [RS:1;jenkins-hbase4:37145] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-01 22:03:42,691 INFO [RS:1;jenkins-hbase4:37145] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-01 22:03:42,691 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-01 22:03:42,691 INFO [RS:1;jenkins-hbase4:37145] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-01 22:03:42,691 INFO [RS:1;jenkins-hbase4:37145] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-01 22:03:42,692 INFO [RS:1;jenkins-hbase4:37145] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37145 2023-10-01 22:03:42,695 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:03:42,695 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 22:03:42,695 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37145,1696197680825 2023-10-01 22:03:42,696 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37145,1696197680825] 2023-10-01 22:03:42,696 DEBUG [RS:0;jenkins-hbase4:42263] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/oldWALs 2023-10-01 22:03:42,696 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37145,1696197680825; numProcessing=2 2023-10-01 22:03:42,696 INFO [RS:0;jenkins-hbase4:42263] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42263%2C1696197680774:(num 1696197682498) 2023-10-01 22:03:42,696 DEBUG [RS:0;jenkins-hbase4:42263] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:03:42,696 INFO [RS:0;jenkins-hbase4:42263] regionserver.LeaseManager(133): Closed leases 2023-10-01 22:03:42,697 INFO [RS:0;jenkins-hbase4:42263] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-01 22:03:42,697 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-01 22:03:42,698 INFO [RS:0;jenkins-hbase4:42263] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42263 2023-10-01 22:03:42,698 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37145,1696197680825 already deleted, retry=false 2023-10-01 22:03:42,698 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37145,1696197680825 expired; onlineServers=1 2023-10-01 22:03:42,700 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42263,1696197680774 2023-10-01 22:03:42,700 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 22:03:42,701 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42263,1696197680774] 2023-10-01 22:03:42,701 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42263,1696197680774; numProcessing=3 2023-10-01 22:03:42,702 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42263,1696197680774 already deleted, retry=false 2023-10-01 22:03:42,702 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42263,1696197680774 expired; onlineServers=0 2023-10-01 22:03:42,702 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40311,1696197679483' ***** 2023-10-01 22:03:42,702 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-10-01 22:03:42,702 DEBUG [M:0;jenkins-hbase4:40311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68c41d04, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-01 22:03:42,702 INFO [M:0;jenkins-hbase4:40311] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40311,1696197679483 2023-10-01 22:03:42,702 INFO [M:0;jenkins-hbase4:40311] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40311,1696197679483; all regions closed. 2023-10-01 22:03:42,702 DEBUG [M:0;jenkins-hbase4:40311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 22:03:42,702 DEBUG [M:0;jenkins-hbase4:40311] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-10-01 22:03:42,703 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-10-01 22:03:42,703 DEBUG [M:0;jenkins-hbase4:40311] cleaner.HFileCleaner(317): Stopping file delete threads 2023-10-01 22:03:42,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696197682109] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696197682109,5,FailOnTimeoutGroup] 2023-10-01 22:03:42,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696197682109] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696197682109,5,FailOnTimeoutGroup] 2023-10-01 22:03:42,703 INFO [M:0;jenkins-hbase4:40311] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-10-01 22:03:42,703 INFO [M:0;jenkins-hbase4:40311] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-10-01 22:03:42,703 INFO [M:0;jenkins-hbase4:40311] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-10-01 22:03:42,703 DEBUG [M:0;jenkins-hbase4:40311] master.HMaster(1512): Stopping service threads 2023-10-01 22:03:42,703 INFO [M:0;jenkins-hbase4:40311] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-10-01 22:03:42,703 ERROR [M:0;jenkins-hbase4:40311] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT 2023-10-01 22:03:42,703 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-10-01 22:03:42,703 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 22:03:42,704 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-01 22:03:42,704 INFO [M:0;jenkins-hbase4:40311] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-10-01 22:03:42,704 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-10-01 22:03:42,704 DEBUG [M:0;jenkins-hbase4:40311] zookeeper.ZKUtil(398): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-10-01 22:03:42,704 WARN [M:0;jenkins-hbase4:40311] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-10-01 22:03:42,704 INFO [M:0;jenkins-hbase4:40311] assignment.AssignmentManager(315): Stopping assignment manager 2023-10-01 22:03:42,705 INFO [M:0;jenkins-hbase4:40311] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-10-01 22:03:42,705 DEBUG [M:0;jenkins-hbase4:40311] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-01 22:03:42,705 INFO [M:0;jenkins-hbase4:40311] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 22:03:42,705 DEBUG [M:0;jenkins-hbase4:40311] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 22:03:42,705 DEBUG [M:0;jenkins-hbase4:40311] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-01 22:03:42,705 DEBUG [M:0;jenkins-hbase4:40311] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 22:03:42,705 INFO [M:0;jenkins-hbase4:40311] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.69 KB heapSize=452 KB 2023-10-01 22:03:42,718 INFO [M:0;jenkins-hbase4:40311] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.69 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/0361877e5a424a1eaefd6c841a851363 2023-10-01 22:03:42,721 INFO [M:0;jenkins-hbase4:40311] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0361877e5a424a1eaefd6c841a851363 2023-10-01 22:03:42,722 DEBUG [M:0;jenkins-hbase4:40311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/0361877e5a424a1eaefd6c841a851363 as hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/0361877e5a424a1eaefd6c841a851363 2023-10-01 22:03:42,725 INFO [M:0;jenkins-hbase4:40311] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0361877e5a424a1eaefd6c841a851363 2023-10-01 22:03:42,725 INFO [M:0;jenkins-hbase4:40311] regionserver.HStore(1080): Added hdfs://localhost:36919/user/jenkins/test-data/3faef396-dac6-55ec-4767-fb05a68f23b9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/0361877e5a424a1eaefd6c841a851363, entries=119, sequenceid=899, filesize=28.6 K 2023-10-01 22:03:42,726 INFO [M:0;jenkins-hbase4:40311] regionserver.HRegion(2948): Finished flush of dataSize ~375.69 KB/384707, heapSize ~451.98 KB/462832, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=899, compaction requested=false 2023-10-01 22:03:42,727 INFO [M:0;jenkins-hbase4:40311] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 22:03:42,727 DEBUG [M:0;jenkins-hbase4:40311] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-01 22:03:42,730 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-01 22:03:42,730 INFO [M:0;jenkins-hbase4:40311] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-10-01 22:03:42,731 INFO [M:0;jenkins-hbase4:40311] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40311 2023-10-01 22:03:42,733 DEBUG [M:0;jenkins-hbase4:40311] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40311,1696197679483 already deleted, retry=false 2023-10-01 22:03:42,797 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 22:03:42,797 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:37145-0x1010401cd730002, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 22:03:42,797 INFO [RS:1;jenkins-hbase4:37145] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37145,1696197680825; zookeeper connection closed. 2023-10-01 22:03:42,797 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3c100f88] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3c100f88 2023-10-01 22:03:42,897 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 22:03:42,897 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): master:40311-0x1010401cd730000, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 22:03:42,897 INFO [M:0;jenkins-hbase4:40311] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40311,1696197679483; zookeeper connection closed. 2023-10-01 22:03:42,997 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 22:03:42,997 INFO [RS:0;jenkins-hbase4:42263] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42263,1696197680774; zookeeper connection closed. 2023-10-01 22:03:42,997 DEBUG [Listener at localhost/38397-EventThread] zookeeper.ZKWatcher(600): regionserver:42263-0x1010401cd730001, quorum=127.0.0.1:58905, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 22:03:42,998 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@186dc8f3] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@186dc8f3 2023-10-01 22:03:42,998 INFO [Listener at jenkins-hbase4.apache.org/45715] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-10-01 22:03:42,998 WARN [Listener at jenkins-hbase4.apache.org/45715] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-01 22:03:43,001 INFO [Listener at jenkins-hbase4.apache.org/45715] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-01 22:03:43,104 WARN [BP-904612636-172.31.14.131-1696197675797 heartbeating to localhost/127.0.0.1:36919] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-01 22:03:43,104 WARN [BP-904612636-172.31.14.131-1696197675797 heartbeating to localhost/127.0.0.1:36919] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-904612636-172.31.14.131-1696197675797 (Datanode Uuid 44a7e160-a6d1-4708-8ab9-39315d672d97) service to localhost/127.0.0.1:36919 2023-10-01 22:03:43,106 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/cluster_acb7ca10-02c8-106a-9d3a-fe6c12cc0094/dfs/data/data5/current/BP-904612636-172.31.14.131-1696197675797] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-01 22:03:43,106 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/cluster_acb7ca10-02c8-106a-9d3a-fe6c12cc0094/dfs/data/data6/current/BP-904612636-172.31.14.131-1696197675797] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-01 22:03:43,107 WARN [Listener at jenkins-hbase4.apache.org/45715] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-01 22:03:43,109 INFO [Listener at jenkins-hbase4.apache.org/45715] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-01 22:03:43,212 WARN [BP-904612636-172.31.14.131-1696197675797 heartbeating to localhost/127.0.0.1:36919] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-01 22:03:43,212 WARN [BP-904612636-172.31.14.131-1696197675797 heartbeating to localhost/127.0.0.1:36919] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-904612636-172.31.14.131-1696197675797 (Datanode Uuid 89282f88-5912-460c-9d8f-7c35cfc40d16) service to localhost/127.0.0.1:36919 2023-10-01 22:03:43,213 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/cluster_acb7ca10-02c8-106a-9d3a-fe6c12cc0094/dfs/data/data3/current/BP-904612636-172.31.14.131-1696197675797] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-01 22:03:43,213 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/cluster_acb7ca10-02c8-106a-9d3a-fe6c12cc0094/dfs/data/data4/current/BP-904612636-172.31.14.131-1696197675797] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-01 22:03:43,214 WARN [Listener at jenkins-hbase4.apache.org/45715] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-01 22:03:43,216 INFO [Listener at jenkins-hbase4.apache.org/45715] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-01 22:03:43,319 WARN [BP-904612636-172.31.14.131-1696197675797 heartbeating to localhost/127.0.0.1:36919] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-01 22:03:43,319 WARN [BP-904612636-172.31.14.131-1696197675797 heartbeating to localhost/127.0.0.1:36919] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-904612636-172.31.14.131-1696197675797 (Datanode Uuid 0d33a4ea-52ef-4d1b-9689-16605c76b96e) service to localhost/127.0.0.1:36919 2023-10-01 22:03:43,320 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/cluster_acb7ca10-02c8-106a-9d3a-fe6c12cc0094/dfs/data/data1/current/BP-904612636-172.31.14.131-1696197675797] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-01 22:03:43,320 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/51a91704-0df8-4c1e-8ae5-1a00fdec181f/cluster_acb7ca10-02c8-106a-9d3a-fe6c12cc0094/dfs/data/data2/current/BP-904612636-172.31.14.131-1696197675797] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-01 22:03:43,340 INFO [Listener at jenkins-hbase4.apache.org/45715] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-01 22:03:43,466 INFO [Listener at jenkins-hbase4.apache.org/45715] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-10-01 22:03:43,562 INFO [Listener at jenkins-hbase4.apache.org/45715] hbase.HBaseTestingUtility(1293): Minicluster is down