2023-10-02 19:02:23,551 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-10-02 19:02:23,745 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0 2023-10-02 19:02:23,746 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-10-02 19:02:23,746 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-10-02 19:02:23,787 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-10-02 19:02:24,021 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-10-02 19:02:24,021 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/cluster_34384d40-947b-ffab-8334-c2f5aa364294, deleteOnExit=true 2023-10-02 19:02:24,022 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-10-02 19:02:24,022 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/test.cache.data in system properties and HBase conf 2023-10-02 19:02:24,022 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/hadoop.tmp.dir in system properties and HBase conf 2023-10-02 19:02:24,023 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/hadoop.log.dir in system properties and HBase conf 2023-10-02 19:02:24,023 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-02 19:02:24,023 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-02 19:02:24,024 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-02 19:02:24,315 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-10-02 19:02:24,320 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-02 19:02:24,321 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-02 19:02:24,321 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-02 19:02:24,321 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-02 19:02:24,322 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-02 19:02:24,322 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-02 19:02:24,322 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-02 19:02:24,323 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-02 19:02:24,323 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-02 19:02:24,324 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/nfs.dump.dir in system properties and HBase conf 2023-10-02 19:02:24,324 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/java.io.tmpdir in system properties and HBase conf 2023-10-02 19:02:24,324 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-02 19:02:24,325 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-02 19:02:24,325 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-10-02 19:02:24,820 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-02 19:02:24,824 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-02 19:02:25,081 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-10-02 19:02:25,240 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-10-02 19:02:25,252 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-02 19:02:25,287 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-10-02 19:02:25,318 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/java.io.tmpdir/Jetty_localhost_41945_hdfs____.s2wpdl/webapp 2023-10-02 19:02:25,448 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41945 2023-10-02 19:02:25,486 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-02 19:02:25,487 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-02 19:02:25,874 WARN [Listener at localhost/46307] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-02 19:02:25,939 WARN [Listener at localhost/46307] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-02 19:02:25,957 WARN [Listener at localhost/46307] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-02 19:02:25,965 INFO [Listener at localhost/46307] log.Slf4jLog(67): jetty-6.1.26 2023-10-02 19:02:25,970 INFO [Listener at localhost/46307] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/java.io.tmpdir/Jetty_localhost_38279_datanode____cxtzli/webapp 2023-10-02 19:02:26,048 INFO [Listener at localhost/46307] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38279 2023-10-02 19:02:26,490 WARN [Listener at localhost/38253] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-02 19:02:26,504 WARN [Listener at localhost/38253] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-02 19:02:26,508 WARN [Listener at localhost/38253] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-02 19:02:26,510 INFO [Listener at localhost/38253] log.Slf4jLog(67): jetty-6.1.26 2023-10-02 19:02:26,521 INFO [Listener at localhost/38253] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/java.io.tmpdir/Jetty_localhost_36119_datanode____.fyxu83/webapp 2023-10-02 19:02:26,623 INFO [Listener at localhost/38253] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36119 2023-10-02 19:02:26,634 WARN [Listener at localhost/36995] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-02 19:02:26,654 WARN [Listener at localhost/36995] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-02 19:02:26,658 WARN [Listener at localhost/36995] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-02 19:02:26,660 INFO [Listener at localhost/36995] log.Slf4jLog(67): jetty-6.1.26 2023-10-02 19:02:26,671 INFO [Listener at localhost/36995] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/java.io.tmpdir/Jetty_localhost_45883_datanode____hwjwft/webapp 2023-10-02 19:02:26,775 INFO [Listener at localhost/36995] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45883 2023-10-02 19:02:26,790 WARN [Listener at localhost/36391] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-02 19:02:26,997 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x42f7eca9a88174a5: Processing first storage report for DS-31e94e33-5a69-4f59-81ad-737a8ed61fa2 from datanode e311bd43-0362-4f03-81e6-0ee20bc00c02 2023-10-02 19:02:26,999 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x42f7eca9a88174a5: from storage DS-31e94e33-5a69-4f59-81ad-737a8ed61fa2 node DatanodeRegistration(127.0.0.1:33791, datanodeUuid=e311bd43-0362-4f03-81e6-0ee20bc00c02, infoPort=40539, infoSecurePort=0, ipcPort=36391, storageInfo=lv=-57;cid=testClusterID;nsid=1383388680;c=1696273344900), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-10-02 19:02:26,999 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1944e53d3b2740e9: Processing first storage report for DS-5af15e73-a85b-45b6-8052-24e68f845077 from datanode fd21ef95-07f0-48ed-a0b8-dd029034c0b1 2023-10-02 19:02:26,999 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1944e53d3b2740e9: from storage DS-5af15e73-a85b-45b6-8052-24e68f845077 node DatanodeRegistration(127.0.0.1:39979, datanodeUuid=fd21ef95-07f0-48ed-a0b8-dd029034c0b1, infoPort=34331, infoSecurePort=0, ipcPort=38253, storageInfo=lv=-57;cid=testClusterID;nsid=1383388680;c=1696273344900), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-02 19:02:26,999 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x20261a8432f9bf79: Processing first storage report for DS-1e0faf12-d660-4aa9-ac45-dc2a72769288 from datanode bf3b19c6-9e85-4fec-a2d4-bb513bc39b80 2023-10-02 19:02:26,999 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x20261a8432f9bf79: from storage DS-1e0faf12-d660-4aa9-ac45-dc2a72769288 node DatanodeRegistration(127.0.0.1:45759, datanodeUuid=bf3b19c6-9e85-4fec-a2d4-bb513bc39b80, infoPort=35837, infoSecurePort=0, ipcPort=36995, storageInfo=lv=-57;cid=testClusterID;nsid=1383388680;c=1696273344900), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-10-02 19:02:26,999 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x42f7eca9a88174a5: Processing first storage report for DS-2b02cc77-40ee-4fed-86d5-8e0a66fe1d5f from datanode e311bd43-0362-4f03-81e6-0ee20bc00c02 2023-10-02 19:02:26,999 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x42f7eca9a88174a5: from storage DS-2b02cc77-40ee-4fed-86d5-8e0a66fe1d5f node DatanodeRegistration(127.0.0.1:33791, datanodeUuid=e311bd43-0362-4f03-81e6-0ee20bc00c02, infoPort=40539, infoSecurePort=0, ipcPort=36391, storageInfo=lv=-57;cid=testClusterID;nsid=1383388680;c=1696273344900), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-02 19:02:27,000 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1944e53d3b2740e9: Processing first storage report for DS-9b3d5933-313e-4c49-ab79-3837a52556e1 from datanode fd21ef95-07f0-48ed-a0b8-dd029034c0b1 2023-10-02 19:02:27,000 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1944e53d3b2740e9: from storage DS-9b3d5933-313e-4c49-ab79-3837a52556e1 node DatanodeRegistration(127.0.0.1:39979, datanodeUuid=fd21ef95-07f0-48ed-a0b8-dd029034c0b1, infoPort=34331, infoSecurePort=0, ipcPort=38253, storageInfo=lv=-57;cid=testClusterID;nsid=1383388680;c=1696273344900), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-02 19:02:27,000 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x20261a8432f9bf79: Processing first storage report for DS-6245cb2b-a6d9-4e57-a2ae-cc7643d26f7e from datanode bf3b19c6-9e85-4fec-a2d4-bb513bc39b80 2023-10-02 19:02:27,000 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x20261a8432f9bf79: from storage DS-6245cb2b-a6d9-4e57-a2ae-cc7643d26f7e node DatanodeRegistration(127.0.0.1:45759, datanodeUuid=bf3b19c6-9e85-4fec-a2d4-bb513bc39b80, infoPort=35837, infoSecurePort=0, ipcPort=36995, storageInfo=lv=-57;cid=testClusterID;nsid=1383388680;c=1696273344900), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-02 19:02:27,180 DEBUG [Listener at localhost/36391] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0 2023-10-02 19:02:27,272 INFO [Listener at localhost/36391] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/cluster_34384d40-947b-ffab-8334-c2f5aa364294/zookeeper_0, clientPort=60248, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/cluster_34384d40-947b-ffab-8334-c2f5aa364294/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/cluster_34384d40-947b-ffab-8334-c2f5aa364294/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-10-02 19:02:27,290 INFO [Listener at localhost/36391] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60248 2023-10-02 19:02:27,296 INFO [Listener at localhost/36391] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 19:02:27,298 INFO [Listener at localhost/36391] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 19:02:27,947 INFO [Listener at localhost/36391] util.FSUtils(471): Created version file at hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6 with version=8 2023-10-02 19:02:27,947 INFO [Listener at localhost/36391] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/hbase-staging 2023-10-02 19:02:28,311 INFO [Listener at localhost/36391] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-10-02 19:02:28,695 INFO [Listener at localhost/36391] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-10-02 19:02:28,723 INFO [Listener at localhost/36391] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-02 19:02:28,724 INFO [Listener at localhost/36391] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-02 19:02:28,724 INFO [Listener at localhost/36391] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-02 19:02:28,724 INFO [Listener at localhost/36391] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-02 19:02:28,724 INFO [Listener at localhost/36391] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-02 19:02:28,844 INFO [Listener at localhost/36391] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-10-02 19:02:28,909 DEBUG [Listener at localhost/36391] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-10-02 19:02:28,992 INFO [Listener at localhost/36391] ipc.NettyRpcServer(120): Bind to /148.251.75.209:32777 2023-10-02 19:02:29,004 INFO [Listener at localhost/36391] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 19:02:29,006 INFO [Listener at localhost/36391] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 19:02:29,027 INFO [Listener at localhost/36391] zookeeper.RecoverableZooKeeper(93): Process identifier=master:32777 connecting to ZooKeeper ensemble=127.0.0.1:60248 2023-10-02 19:02:29,082 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:327770x0, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-02 19:02:29,085 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:32777-0x100f40803d80000 connected 2023-10-02 19:02:29,110 DEBUG [Listener at localhost/36391] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-02 19:02:29,111 DEBUG [Listener at localhost/36391] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-02 19:02:29,121 DEBUG [Listener at localhost/36391] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-02 19:02:29,128 DEBUG [Listener at localhost/36391] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=32777 2023-10-02 19:02:29,128 DEBUG [Listener at localhost/36391] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=32777 2023-10-02 19:02:29,129 DEBUG [Listener at localhost/36391] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=32777 2023-10-02 19:02:29,129 DEBUG [Listener at localhost/36391] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=32777 2023-10-02 19:02:29,129 DEBUG [Listener at localhost/36391] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=32777 2023-10-02 19:02:29,135 INFO [Listener at localhost/36391] master.HMaster(444): hbase.rootdir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6, hbase.cluster.distributed=false 2023-10-02 19:02:29,188 INFO [Listener at localhost/36391] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-10-02 19:02:29,188 INFO [Listener at localhost/36391] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-02 19:02:29,188 INFO [Listener at localhost/36391] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-02 19:02:29,188 INFO [Listener at localhost/36391] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-02 19:02:29,188 INFO [Listener at localhost/36391] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-02 19:02:29,189 INFO [Listener at localhost/36391] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-02 19:02:29,192 INFO [Listener at localhost/36391] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-02 19:02:29,195 INFO [Listener at localhost/36391] ipc.NettyRpcServer(120): Bind to /148.251.75.209:34425 2023-10-02 19:02:29,198 INFO [Listener at localhost/36391] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-02 19:02:29,203 INFO [Listener at localhost/36391] mob.MobFileCache(125): MobFileCache disabled 2023-10-02 19:02:29,204 INFO [Listener at localhost/36391] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 19:02:29,207 INFO [Listener at localhost/36391] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 19:02:29,209 INFO [Listener at localhost/36391] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34425 connecting to ZooKeeper ensemble=127.0.0.1:60248 2023-10-02 19:02:29,212 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:344250x0, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-02 19:02:29,214 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34425-0x100f40803d80001 connected 2023-10-02 19:02:29,214 DEBUG [Listener at localhost/36391] zookeeper.ZKUtil(164): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-02 19:02:29,215 DEBUG [Listener at localhost/36391] zookeeper.ZKUtil(164): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-02 19:02:29,216 DEBUG [Listener at localhost/36391] zookeeper.ZKUtil(164): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-02 19:02:29,218 DEBUG [Listener at localhost/36391] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34425 2023-10-02 19:02:29,218 DEBUG [Listener at localhost/36391] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34425 2023-10-02 19:02:29,219 DEBUG [Listener at localhost/36391] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34425 2023-10-02 19:02:29,219 DEBUG [Listener at localhost/36391] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34425 2023-10-02 19:02:29,219 DEBUG [Listener at localhost/36391] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34425 2023-10-02 19:02:29,230 INFO [Listener at localhost/36391] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-10-02 19:02:29,230 INFO [Listener at localhost/36391] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-02 19:02:29,230 INFO [Listener at localhost/36391] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-02 19:02:29,230 INFO [Listener at localhost/36391] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-02 19:02:29,231 INFO [Listener at localhost/36391] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-02 19:02:29,231 INFO [Listener at localhost/36391] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-02 19:02:29,231 INFO [Listener at localhost/36391] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-02 19:02:29,233 INFO [Listener at localhost/36391] ipc.NettyRpcServer(120): Bind to /148.251.75.209:38887 2023-10-02 19:02:29,233 INFO [Listener at localhost/36391] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-02 19:02:29,234 INFO [Listener at localhost/36391] mob.MobFileCache(125): MobFileCache disabled 2023-10-02 19:02:29,235 INFO [Listener at localhost/36391] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 19:02:29,237 INFO [Listener at localhost/36391] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 19:02:29,240 INFO [Listener at localhost/36391] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38887 connecting to ZooKeeper ensemble=127.0.0.1:60248 2023-10-02 19:02:29,243 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:388870x0, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-02 19:02:29,244 DEBUG [Listener at localhost/36391] zookeeper.ZKUtil(164): regionserver:388870x0, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-02 19:02:29,245 DEBUG [Listener at localhost/36391] zookeeper.ZKUtil(164): regionserver:388870x0, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-02 19:02:29,246 DEBUG [Listener at localhost/36391] zookeeper.ZKUtil(164): regionserver:388870x0, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-02 19:02:29,247 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38887-0x100f40803d80002 connected 2023-10-02 19:02:29,247 DEBUG [Listener at localhost/36391] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38887 2023-10-02 19:02:29,247 DEBUG [Listener at localhost/36391] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38887 2023-10-02 19:02:29,247 DEBUG [Listener at localhost/36391] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38887 2023-10-02 19:02:29,248 DEBUG [Listener at localhost/36391] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38887 2023-10-02 19:02:29,248 DEBUG [Listener at localhost/36391] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38887 2023-10-02 19:02:29,258 INFO [Listener at localhost/36391] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-10-02 19:02:29,259 INFO [Listener at localhost/36391] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-02 19:02:29,259 INFO [Listener at localhost/36391] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-02 19:02:29,259 INFO [Listener at localhost/36391] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-02 19:02:29,259 INFO [Listener at localhost/36391] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-02 19:02:29,259 INFO [Listener at localhost/36391] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-02 19:02:29,259 INFO [Listener at localhost/36391] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-02 19:02:29,261 INFO [Listener at localhost/36391] ipc.NettyRpcServer(120): Bind to /148.251.75.209:32897 2023-10-02 19:02:29,261 INFO [Listener at localhost/36391] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-02 19:02:29,263 INFO [Listener at localhost/36391] mob.MobFileCache(125): MobFileCache disabled 2023-10-02 19:02:29,264 INFO [Listener at localhost/36391] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 19:02:29,265 INFO [Listener at localhost/36391] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 19:02:29,267 INFO [Listener at localhost/36391] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:32897 connecting to ZooKeeper ensemble=127.0.0.1:60248 2023-10-02 19:02:29,270 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:328970x0, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-02 19:02:29,271 DEBUG [Listener at localhost/36391] zookeeper.ZKUtil(164): regionserver:328970x0, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-02 19:02:29,272 DEBUG [Listener at localhost/36391] zookeeper.ZKUtil(164): regionserver:328970x0, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-02 19:02:29,273 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:32897-0x100f40803d80003 connected 2023-10-02 19:02:29,273 DEBUG [Listener at localhost/36391] zookeeper.ZKUtil(164): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-02 19:02:29,275 DEBUG [Listener at localhost/36391] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=32897 2023-10-02 19:02:29,277 DEBUG [Listener at localhost/36391] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=32897 2023-10-02 19:02:29,277 DEBUG [Listener at localhost/36391] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=32897 2023-10-02 19:02:29,278 DEBUG [Listener at localhost/36391] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=32897 2023-10-02 19:02:29,279 DEBUG [Listener at localhost/36391] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=32897 2023-10-02 19:02:29,280 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,32777,1696273348175 2023-10-02 19:02:29,288 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-02 19:02:29,290 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,32777,1696273348175 2023-10-02 19:02:29,308 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-02 19:02:29,308 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-02 19:02:29,308 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-02 19:02:29,308 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-02 19:02:29,308 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 19:02:29,309 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-02 19:02:29,311 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,32777,1696273348175 from backup master directory 2023-10-02 19:02:29,311 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-02 19:02:29,316 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,32777,1696273348175 2023-10-02 19:02:29,316 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-02 19:02:29,317 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-02 19:02:29,317 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,32777,1696273348175 2023-10-02 19:02:29,321 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-10-02 19:02:29,323 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-10-02 19:02:29,418 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/hbase.id with ID: b47f453e-5e7a-45ce-b51a-7b2f803dc7f4 2023-10-02 19:02:29,464 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 19:02:29,479 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 19:02:29,526 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x459c1dca to 127.0.0.1:60248 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 19:02:29,556 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4baf2300, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 19:02:29,580 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-02 19:02:29,582 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-10-02 19:02:29,597 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-10-02 19:02:29,597 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-10-02 19:02:29,600 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-02 19:02:29,604 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-02 19:02:29,606 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-02 19:02:29,637 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/MasterData/data/master/store-tmp 2023-10-02 19:02:29,676 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:02:29,676 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-02 19:02:29,676 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-02 19:02:29,677 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-02 19:02:29,677 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-02 19:02:29,677 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-02 19:02:29,677 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-02 19:02:29,677 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-02 19:02:29,679 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/MasterData/WALs/jenkins-hbase20.apache.org,32777,1696273348175 2023-10-02 19:02:29,701 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C32777%2C1696273348175, suffix=, logDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/MasterData/WALs/jenkins-hbase20.apache.org,32777,1696273348175, archiveDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/MasterData/oldWALs, maxLogs=10 2023-10-02 19:02:29,757 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33791,DS-31e94e33-5a69-4f59-81ad-737a8ed61fa2,DISK] 2023-10-02 19:02:29,757 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39979,DS-5af15e73-a85b-45b6-8052-24e68f845077,DISK] 2023-10-02 19:02:29,757 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45759,DS-1e0faf12-d660-4aa9-ac45-dc2a72769288,DISK] 2023-10-02 19:02:29,764 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-10-02 19:02:29,825 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/MasterData/WALs/jenkins-hbase20.apache.org,32777,1696273348175/jenkins-hbase20.apache.org%2C32777%2C1696273348175.1696273349711 2023-10-02 19:02:29,825 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45759,DS-1e0faf12-d660-4aa9-ac45-dc2a72769288,DISK], DatanodeInfoWithStorage[127.0.0.1:33791,DS-31e94e33-5a69-4f59-81ad-737a8ed61fa2,DISK], DatanodeInfoWithStorage[127.0.0.1:39979,DS-5af15e73-a85b-45b6-8052-24e68f845077,DISK]] 2023-10-02 19:02:29,826 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-10-02 19:02:29,826 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:02:29,829 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-10-02 19:02:29,830 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-10-02 19:02:29,887 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-10-02 19:02:29,893 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-10-02 19:02:29,917 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-10-02 19:02:29,929 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 19:02:29,936 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-02 19:02:29,938 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-02 19:02:29,953 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-10-02 19:02:29,958 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 19:02:29,959 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67483868, jitterRate=0.0055879950523376465}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 19:02:29,959 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-02 19:02:29,960 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-10-02 19:02:29,979 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-10-02 19:02:29,979 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-10-02 19:02:29,982 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-10-02 19:02:29,984 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-10-02 19:02:30,016 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 31 msec 2023-10-02 19:02:30,016 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-10-02 19:02:30,041 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-10-02 19:02:30,046 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-10-02 19:02:30,069 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-10-02 19:02:30,073 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-10-02 19:02:30,075 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-10-02 19:02:30,080 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-10-02 19:02:30,083 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-10-02 19:02:30,086 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 19:02:30,087 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-10-02 19:02:30,088 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-10-02 19:02:30,102 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-10-02 19:02:30,106 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-02 19:02:30,106 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-02 19:02:30,106 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-02 19:02:30,106 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 19:02:30,106 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-02 19:02:30,107 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,32777,1696273348175, sessionid=0x100f40803d80000, setting cluster-up flag (Was=false) 2023-10-02 19:02:30,122 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 19:02:30,126 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-10-02 19:02:30,127 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,32777,1696273348175 2023-10-02 19:02:30,133 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 19:02:30,137 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-10-02 19:02:30,138 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,32777,1696273348175 2023-10-02 19:02:30,140 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp 2023-10-02 19:02:30,182 INFO [RS:0;jenkins-hbase20:34425] regionserver.HRegionServer(951): ClusterId : b47f453e-5e7a-45ce-b51a-7b2f803dc7f4 2023-10-02 19:02:30,182 INFO [RS:2;jenkins-hbase20:32897] regionserver.HRegionServer(951): ClusterId : b47f453e-5e7a-45ce-b51a-7b2f803dc7f4 2023-10-02 19:02:30,183 INFO [RS:1;jenkins-hbase20:38887] regionserver.HRegionServer(951): ClusterId : b47f453e-5e7a-45ce-b51a-7b2f803dc7f4 2023-10-02 19:02:30,188 DEBUG [RS:1;jenkins-hbase20:38887] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-02 19:02:30,188 DEBUG [RS:2;jenkins-hbase20:32897] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-02 19:02:30,188 DEBUG [RS:0;jenkins-hbase20:34425] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-02 19:02:30,194 DEBUG [RS:0;jenkins-hbase20:34425] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-02 19:02:30,194 DEBUG [RS:2;jenkins-hbase20:32897] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-02 19:02:30,194 DEBUG [RS:1;jenkins-hbase20:38887] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-02 19:02:30,194 DEBUG [RS:2;jenkins-hbase20:32897] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-02 19:02:30,194 DEBUG [RS:0;jenkins-hbase20:34425] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-02 19:02:30,194 DEBUG [RS:1;jenkins-hbase20:38887] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-02 19:02:30,198 DEBUG [RS:2;jenkins-hbase20:32897] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-02 19:02:30,199 DEBUG [RS:0;jenkins-hbase20:34425] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-02 19:02:30,200 DEBUG [RS:1;jenkins-hbase20:38887] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-02 19:02:30,201 DEBUG [RS:2;jenkins-hbase20:32897] zookeeper.ReadOnlyZKClient(139): Connect 0x7b91b45b to 127.0.0.1:60248 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 19:02:30,202 DEBUG [RS:0;jenkins-hbase20:34425] zookeeper.ReadOnlyZKClient(139): Connect 0x41bdb7b3 to 127.0.0.1:60248 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 19:02:30,203 DEBUG [RS:1;jenkins-hbase20:38887] zookeeper.ReadOnlyZKClient(139): Connect 0x37e735bc to 127.0.0.1:60248 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 19:02:30,215 DEBUG [RS:2;jenkins-hbase20:32897] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75564559, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 19:02:30,215 DEBUG [RS:0;jenkins-hbase20:34425] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f7a51f4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 19:02:30,215 DEBUG [RS:2;jenkins-hbase20:32897] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7169df2b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-10-02 19:02:30,215 DEBUG [RS:0;jenkins-hbase20:34425] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b45dcc3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-10-02 19:02:30,233 DEBUG [RS:1;jenkins-hbase20:38887] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3920cd30, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 19:02:30,233 DEBUG [RS:1;jenkins-hbase20:38887] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d1f5ecc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-10-02 19:02:30,254 DEBUG [RS:1;jenkins-hbase20:38887] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:38887 2023-10-02 19:02:30,254 DEBUG [RS:2;jenkins-hbase20:32897] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase20:32897 2023-10-02 19:02:30,257 DEBUG [RS:0;jenkins-hbase20:34425] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:34425 2023-10-02 19:02:30,260 INFO [RS:1;jenkins-hbase20:38887] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-02 19:02:30,260 INFO [RS:0;jenkins-hbase20:34425] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-02 19:02:30,260 INFO [RS:0;jenkins-hbase20:34425] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-02 19:02:30,260 INFO [RS:2;jenkins-hbase20:32897] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-02 19:02:30,261 INFO [RS:2;jenkins-hbase20:32897] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-02 19:02:30,260 INFO [RS:1;jenkins-hbase20:38887] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-02 19:02:30,267 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-10-02 19:02:30,267 DEBUG [RS:0;jenkins-hbase20:34425] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-02 19:02:30,267 DEBUG [RS:2;jenkins-hbase20:32897] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-02 19:02:30,267 DEBUG [RS:1;jenkins-hbase20:38887] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-02 19:02:30,269 INFO [RS:1;jenkins-hbase20:38887] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 19:02:30,269 INFO [RS:0;jenkins-hbase20:34425] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 19:02:30,269 INFO [master/jenkins-hbase20:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 19:02:30,269 INFO [RS:2;jenkins-hbase20:32897] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 19:02:30,270 DEBUG [RS:2;jenkins-hbase20:32897] regionserver.HRegionServer(1022): About to register with Master. 2023-10-02 19:02:30,270 DEBUG [RS:0;jenkins-hbase20:34425] regionserver.HRegionServer(1022): About to register with Master. 2023-10-02 19:02:30,270 INFO [master/jenkins-hbase20:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-10-02 19:02:30,270 DEBUG [RS:1;jenkins-hbase20:38887] regionserver.HRegionServer(1022): About to register with Master. 2023-10-02 19:02:30,273 INFO [RS:1;jenkins-hbase20:38887] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,32777,1696273348175 with isa=jenkins-hbase20.apache.org/148.251.75.209:38887, startcode=1696273349229 2023-10-02 19:02:30,273 INFO [RS:0;jenkins-hbase20:34425] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,32777,1696273348175 with isa=jenkins-hbase20.apache.org/148.251.75.209:34425, startcode=1696273349187 2023-10-02 19:02:30,273 INFO [RS:2;jenkins-hbase20:32897] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,32777,1696273348175 with isa=jenkins-hbase20.apache.org/148.251.75.209:32897, startcode=1696273349258 2023-10-02 19:02:30,294 DEBUG [RS:0;jenkins-hbase20:34425] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-02 19:02:30,294 DEBUG [RS:2;jenkins-hbase20:32897] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-02 19:02:30,295 DEBUG [RS:1;jenkins-hbase20:38887] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-02 19:02:30,354 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34355, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-10-02 19:02:30,354 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42983, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-10-02 19:02:30,354 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39037, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-10-02 19:02:30,364 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-02 19:02:30,366 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-10-02 19:02:30,372 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-02 19:02:30,373 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-02 19:02:30,380 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-10-02 19:02:30,380 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-10-02 19:02:30,380 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-10-02 19:02:30,381 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-10-02 19:02:30,381 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-10-02 19:02:30,381 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-02 19:02:30,381 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-10-02 19:02:30,381 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-02 19:02:30,382 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1696273380382 2023-10-02 19:02:30,385 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-10-02 19:02:30,389 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-10-02 19:02:30,390 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-10-02 19:02:30,394 DEBUG [RS:0;jenkins-hbase20:34425] regionserver.HRegionServer(2830): Master is not running yet 2023-10-02 19:02:30,394 DEBUG [RS:1;jenkins-hbase20:38887] regionserver.HRegionServer(2830): Master is not running yet 2023-10-02 19:02:30,395 WARN [RS:0;jenkins-hbase20:34425] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-02 19:02:30,394 DEBUG [RS:2;jenkins-hbase20:32897] regionserver.HRegionServer(2830): Master is not running yet 2023-10-02 19:02:30,395 WARN [RS:1;jenkins-hbase20:38887] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-02 19:02:30,395 WARN [RS:2;jenkins-hbase20:32897] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-02 19:02:30,395 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-02 19:02:30,397 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-10-02 19:02:30,403 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-10-02 19:02:30,404 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-10-02 19:02:30,404 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-10-02 19:02:30,404 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-10-02 19:02:30,405 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-02 19:02:30,407 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-10-02 19:02:30,409 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-10-02 19:02:30,409 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-10-02 19:02:30,412 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-10-02 19:02:30,413 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-10-02 19:02:30,416 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1696273350415,5,FailOnTimeoutGroup] 2023-10-02 19:02:30,418 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1696273350417,5,FailOnTimeoutGroup] 2023-10-02 19:02:30,418 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-02 19:02:30,419 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-10-02 19:02:30,421 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-10-02 19:02:30,421 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-10-02 19:02:30,436 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-02 19:02:30,437 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-02 19:02:30,437 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6 2023-10-02 19:02:30,457 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:02:30,460 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-02 19:02:30,462 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/meta/1588230740/info 2023-10-02 19:02:30,463 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-02 19:02:30,464 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 19:02:30,464 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-02 19:02:30,467 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/meta/1588230740/rep_barrier 2023-10-02 19:02:30,467 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-02 19:02:30,468 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 19:02:30,468 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-02 19:02:30,470 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/meta/1588230740/table 2023-10-02 19:02:30,471 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-02 19:02:30,472 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 19:02:30,474 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/meta/1588230740 2023-10-02 19:02:30,475 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/meta/1588230740 2023-10-02 19:02:30,478 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-02 19:02:30,481 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-02 19:02:30,485 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 19:02:30,486 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61384330, jitterRate=-0.0853022038936615}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-02 19:02:30,486 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-02 19:02:30,486 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-02 19:02:30,486 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-02 19:02:30,486 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-02 19:02:30,486 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-02 19:02:30,487 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-02 19:02:30,488 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-02 19:02:30,489 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-02 19:02:30,494 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-10-02 19:02:30,494 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-10-02 19:02:30,496 INFO [RS:1;jenkins-hbase20:38887] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,32777,1696273348175 with isa=jenkins-hbase20.apache.org/148.251.75.209:38887, startcode=1696273349229 2023-10-02 19:02:30,496 INFO [RS:0;jenkins-hbase20:34425] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,32777,1696273348175 with isa=jenkins-hbase20.apache.org/148.251.75.209:34425, startcode=1696273349187 2023-10-02 19:02:30,496 INFO [RS:2;jenkins-hbase20:32897] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,32777,1696273348175 with isa=jenkins-hbase20.apache.org/148.251.75.209:32897, startcode=1696273349258 2023-10-02 19:02:30,502 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32777] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:30,507 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-10-02 19:02:30,509 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32777] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:30,510 DEBUG [RS:2;jenkins-hbase20:32897] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6 2023-10-02 19:02:30,510 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32777] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:30,510 DEBUG [RS:2;jenkins-hbase20:32897] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:46307 2023-10-02 19:02:30,511 DEBUG [RS:2;jenkins-hbase20:32897] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-02 19:02:30,511 DEBUG [RS:0;jenkins-hbase20:34425] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6 2023-10-02 19:02:30,511 DEBUG [RS:0;jenkins-hbase20:34425] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:46307 2023-10-02 19:02:30,512 DEBUG [RS:0;jenkins-hbase20:34425] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-02 19:02:30,513 DEBUG [RS:1;jenkins-hbase20:38887] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6 2023-10-02 19:02:30,513 DEBUG [RS:1;jenkins-hbase20:38887] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:46307 2023-10-02 19:02:30,513 DEBUG [RS:1;jenkins-hbase20:38887] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-02 19:02:30,519 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-02 19:02:30,520 DEBUG [RS:0;jenkins-hbase20:34425] zookeeper.ZKUtil(162): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:30,521 DEBUG [RS:2;jenkins-hbase20:32897] zookeeper.ZKUtil(162): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:30,521 WARN [RS:0;jenkins-hbase20:34425] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-02 19:02:30,521 DEBUG [RS:1;jenkins-hbase20:38887] zookeeper.ZKUtil(162): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:30,521 INFO [RS:0;jenkins-hbase20:34425] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-02 19:02:30,521 WARN [RS:1;jenkins-hbase20:38887] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-02 19:02:30,521 WARN [RS:2;jenkins-hbase20:32897] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-02 19:02:30,522 DEBUG [RS:0;jenkins-hbase20:34425] regionserver.HRegionServer(1948): logDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/WALs/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:30,522 INFO [RS:2;jenkins-hbase20:32897] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-02 19:02:30,522 DEBUG [RS:2;jenkins-hbase20:32897] regionserver.HRegionServer(1948): logDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/WALs/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:30,521 INFO [RS:1;jenkins-hbase20:38887] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-02 19:02:30,523 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,32897,1696273349258] 2023-10-02 19:02:30,523 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,34425,1696273349187] 2023-10-02 19:02:30,523 DEBUG [RS:1;jenkins-hbase20:38887] regionserver.HRegionServer(1948): logDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/WALs/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:30,523 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,38887,1696273349229] 2023-10-02 19:02:30,532 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-10-02 19:02:30,534 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-10-02 19:02:30,538 DEBUG [RS:1;jenkins-hbase20:38887] zookeeper.ZKUtil(162): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:30,538 DEBUG [RS:0;jenkins-hbase20:34425] zookeeper.ZKUtil(162): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:30,538 DEBUG [RS:2;jenkins-hbase20:32897] zookeeper.ZKUtil(162): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:30,538 DEBUG [RS:1;jenkins-hbase20:38887] zookeeper.ZKUtil(162): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:30,538 DEBUG [RS:0;jenkins-hbase20:34425] zookeeper.ZKUtil(162): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:30,539 DEBUG [RS:2;jenkins-hbase20:32897] zookeeper.ZKUtil(162): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:30,539 DEBUG [RS:1;jenkins-hbase20:38887] zookeeper.ZKUtil(162): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:30,539 DEBUG [RS:0;jenkins-hbase20:34425] zookeeper.ZKUtil(162): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:30,539 DEBUG [RS:2;jenkins-hbase20:32897] zookeeper.ZKUtil(162): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:30,549 DEBUG [RS:2;jenkins-hbase20:32897] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-02 19:02:30,549 DEBUG [RS:0;jenkins-hbase20:34425] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-02 19:02:30,549 DEBUG [RS:1;jenkins-hbase20:38887] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-02 19:02:30,559 INFO [RS:0;jenkins-hbase20:34425] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-02 19:02:30,559 INFO [RS:1;jenkins-hbase20:38887] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-02 19:02:30,559 INFO [RS:2;jenkins-hbase20:32897] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-02 19:02:30,580 INFO [RS:2;jenkins-hbase20:32897] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-02 19:02:30,580 INFO [RS:1;jenkins-hbase20:38887] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-02 19:02:30,580 INFO [RS:0;jenkins-hbase20:34425] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-02 19:02:30,584 INFO [RS:2;jenkins-hbase20:32897] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-02 19:02:30,584 INFO [RS:2;jenkins-hbase20:32897] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-02 19:02:30,585 INFO [RS:1;jenkins-hbase20:38887] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-02 19:02:30,585 INFO [RS:0;jenkins-hbase20:34425] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-02 19:02:30,586 INFO [RS:2;jenkins-hbase20:32897] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-02 19:02:30,586 INFO [RS:1;jenkins-hbase20:38887] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-02 19:02:30,586 INFO [RS:0;jenkins-hbase20:34425] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-02 19:02:30,586 INFO [RS:1;jenkins-hbase20:38887] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-02 19:02:30,587 INFO [RS:0;jenkins-hbase20:34425] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-02 19:02:30,595 INFO [RS:1;jenkins-hbase20:38887] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-02 19:02:30,595 INFO [RS:0;jenkins-hbase20:34425] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-02 19:02:30,595 INFO [RS:2;jenkins-hbase20:32897] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-02 19:02:30,595 DEBUG [RS:1;jenkins-hbase20:38887] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-02 19:02:30,595 DEBUG [RS:0;jenkins-hbase20:34425] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-02 19:02:30,595 DEBUG [RS:2;jenkins-hbase20:32897] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-02 19:02:30,595 DEBUG [RS:0;jenkins-hbase20:34425] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-02 19:02:30,596 DEBUG [RS:2;jenkins-hbase20:32897] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-02 19:02:30,595 DEBUG [RS:1;jenkins-hbase20:38887] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-02 19:02:30,596 DEBUG [RS:0;jenkins-hbase20:34425] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-02 19:02:30,596 DEBUG [RS:1;jenkins-hbase20:38887] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-02 19:02:30,596 DEBUG [RS:2;jenkins-hbase20:32897] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-02 19:02:30,596 DEBUG [RS:1;jenkins-hbase20:38887] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-02 19:02:30,596 DEBUG [RS:2;jenkins-hbase20:32897] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-02 19:02:30,596 DEBUG [RS:1;jenkins-hbase20:38887] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-02 19:02:30,596 DEBUG [RS:0;jenkins-hbase20:34425] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-02 19:02:30,596 DEBUG [RS:1;jenkins-hbase20:38887] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-10-02 19:02:30,596 DEBUG [RS:2;jenkins-hbase20:32897] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-02 19:02:30,596 DEBUG [RS:0;jenkins-hbase20:34425] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-02 19:02:30,596 DEBUG [RS:2;jenkins-hbase20:32897] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-10-02 19:02:30,596 DEBUG [RS:1;jenkins-hbase20:38887] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-02 19:02:30,596 DEBUG [RS:2;jenkins-hbase20:32897] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-02 19:02:30,596 DEBUG [RS:0;jenkins-hbase20:34425] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-10-02 19:02:30,597 DEBUG [RS:2;jenkins-hbase20:32897] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-02 19:02:30,597 DEBUG [RS:1;jenkins-hbase20:38887] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-02 19:02:30,597 DEBUG [RS:2;jenkins-hbase20:32897] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-02 19:02:30,597 DEBUG [RS:0;jenkins-hbase20:34425] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-02 19:02:30,597 DEBUG [RS:2;jenkins-hbase20:32897] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-02 19:02:30,597 DEBUG [RS:0;jenkins-hbase20:34425] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-02 19:02:30,597 DEBUG [RS:1;jenkins-hbase20:38887] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-02 19:02:30,597 DEBUG [RS:0;jenkins-hbase20:34425] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-02 19:02:30,598 DEBUG [RS:1;jenkins-hbase20:38887] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-02 19:02:30,598 DEBUG [RS:0;jenkins-hbase20:34425] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-02 19:02:30,601 INFO [RS:1;jenkins-hbase20:38887] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-02 19:02:30,601 INFO [RS:2;jenkins-hbase20:32897] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-02 19:02:30,601 INFO [RS:1;jenkins-hbase20:38887] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-02 19:02:30,601 INFO [RS:2;jenkins-hbase20:32897] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-02 19:02:30,601 INFO [RS:1;jenkins-hbase20:38887] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-02 19:02:30,601 INFO [RS:2;jenkins-hbase20:32897] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-02 19:02:30,601 INFO [RS:0;jenkins-hbase20:34425] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-02 19:02:30,601 INFO [RS:0;jenkins-hbase20:34425] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-02 19:02:30,601 INFO [RS:0;jenkins-hbase20:34425] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-02 19:02:30,615 INFO [RS:1;jenkins-hbase20:38887] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-02 19:02:30,617 INFO [RS:2;jenkins-hbase20:32897] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-02 19:02:30,617 INFO [RS:0;jenkins-hbase20:34425] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-02 19:02:30,619 INFO [RS:2;jenkins-hbase20:32897] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,32897,1696273349258-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-02 19:02:30,619 INFO [RS:1;jenkins-hbase20:38887] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38887,1696273349229-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-02 19:02:30,619 INFO [RS:0;jenkins-hbase20:34425] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,34425,1696273349187-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-02 19:02:30,634 INFO [RS:1;jenkins-hbase20:38887] regionserver.Replication(203): jenkins-hbase20.apache.org,38887,1696273349229 started 2023-10-02 19:02:30,634 INFO [RS:1;jenkins-hbase20:38887] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,38887,1696273349229, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:38887, sessionid=0x100f40803d80002 2023-10-02 19:02:30,634 DEBUG [RS:1;jenkins-hbase20:38887] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-02 19:02:30,635 DEBUG [RS:1;jenkins-hbase20:38887] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:30,635 DEBUG [RS:1;jenkins-hbase20:38887] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,38887,1696273349229' 2023-10-02 19:02:30,635 DEBUG [RS:1;jenkins-hbase20:38887] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-02 19:02:30,635 DEBUG [RS:1;jenkins-hbase20:38887] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-02 19:02:30,636 DEBUG [RS:1;jenkins-hbase20:38887] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-02 19:02:30,636 DEBUG [RS:1;jenkins-hbase20:38887] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-02 19:02:30,636 DEBUG [RS:1;jenkins-hbase20:38887] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:30,636 DEBUG [RS:1;jenkins-hbase20:38887] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,38887,1696273349229' 2023-10-02 19:02:30,636 DEBUG [RS:1;jenkins-hbase20:38887] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:02:30,636 DEBUG [RS:1;jenkins-hbase20:38887] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:02:30,637 DEBUG [RS:1;jenkins-hbase20:38887] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-02 19:02:30,637 INFO [RS:1;jenkins-hbase20:38887] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-02 19:02:30,637 INFO [RS:1;jenkins-hbase20:38887] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-02 19:02:30,637 INFO [RS:0;jenkins-hbase20:34425] regionserver.Replication(203): jenkins-hbase20.apache.org,34425,1696273349187 started 2023-10-02 19:02:30,637 INFO [RS:0;jenkins-hbase20:34425] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,34425,1696273349187, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:34425, sessionid=0x100f40803d80001 2023-10-02 19:02:30,638 INFO [RS:2;jenkins-hbase20:32897] regionserver.Replication(203): jenkins-hbase20.apache.org,32897,1696273349258 started 2023-10-02 19:02:30,638 DEBUG [RS:0;jenkins-hbase20:34425] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-02 19:02:30,638 INFO [RS:2;jenkins-hbase20:32897] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,32897,1696273349258, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:32897, sessionid=0x100f40803d80003 2023-10-02 19:02:30,638 DEBUG [RS:0;jenkins-hbase20:34425] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:30,639 DEBUG [RS:2;jenkins-hbase20:32897] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-02 19:02:30,639 DEBUG [RS:0;jenkins-hbase20:34425] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,34425,1696273349187' 2023-10-02 19:02:30,639 DEBUG [RS:2;jenkins-hbase20:32897] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:30,639 DEBUG [RS:0;jenkins-hbase20:34425] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-02 19:02:30,639 DEBUG [RS:2;jenkins-hbase20:32897] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,32897,1696273349258' 2023-10-02 19:02:30,640 DEBUG [RS:2;jenkins-hbase20:32897] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-02 19:02:30,640 DEBUG [RS:2;jenkins-hbase20:32897] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-02 19:02:30,640 DEBUG [RS:0;jenkins-hbase20:34425] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-02 19:02:30,641 DEBUG [RS:2;jenkins-hbase20:32897] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-02 19:02:30,641 DEBUG [RS:2;jenkins-hbase20:32897] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-02 19:02:30,641 DEBUG [RS:0;jenkins-hbase20:34425] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-02 19:02:30,641 DEBUG [RS:2;jenkins-hbase20:32897] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:30,642 DEBUG [RS:2;jenkins-hbase20:32897] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,32897,1696273349258' 2023-10-02 19:02:30,643 DEBUG [RS:2;jenkins-hbase20:32897] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:02:30,642 DEBUG [RS:0;jenkins-hbase20:34425] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-02 19:02:30,643 DEBUG [RS:0;jenkins-hbase20:34425] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:30,643 DEBUG [RS:0;jenkins-hbase20:34425] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,34425,1696273349187' 2023-10-02 19:02:30,643 DEBUG [RS:0;jenkins-hbase20:34425] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:02:30,643 DEBUG [RS:2;jenkins-hbase20:32897] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:02:30,643 DEBUG [RS:0;jenkins-hbase20:34425] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:02:30,644 DEBUG [RS:2;jenkins-hbase20:32897] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-02 19:02:30,644 DEBUG [RS:0;jenkins-hbase20:34425] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-02 19:02:30,644 INFO [RS:2;jenkins-hbase20:32897] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-02 19:02:30,644 INFO [RS:0;jenkins-hbase20:34425] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-02 19:02:30,644 INFO [RS:2;jenkins-hbase20:32897] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-02 19:02:30,644 INFO [RS:0;jenkins-hbase20:34425] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-02 19:02:30,686 DEBUG [jenkins-hbase20:32777] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-10-02 19:02:30,690 DEBUG [jenkins-hbase20:32777] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-10-02 19:02:30,695 DEBUG [jenkins-hbase20:32777] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 19:02:30,696 DEBUG [jenkins-hbase20:32777] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 19:02:30,696 DEBUG [jenkins-hbase20:32777] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 19:02:30,696 DEBUG [jenkins-hbase20:32777] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 19:02:30,698 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,38887,1696273349229, state=OPENING 2023-10-02 19:02:30,705 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-10-02 19:02:30,706 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 19:02:30,706 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-02 19:02:30,710 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,38887,1696273349229}] 2023-10-02 19:02:30,746 INFO [RS:1;jenkins-hbase20:38887] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C38887%2C1696273349229, suffix=, logDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/WALs/jenkins-hbase20.apache.org,38887,1696273349229, archiveDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/oldWALs, maxLogs=32 2023-10-02 19:02:30,747 INFO [RS:0;jenkins-hbase20:34425] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C34425%2C1696273349187, suffix=, logDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/WALs/jenkins-hbase20.apache.org,34425,1696273349187, archiveDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/oldWALs, maxLogs=32 2023-10-02 19:02:30,747 INFO [RS:2;jenkins-hbase20:32897] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C32897%2C1696273349258, suffix=, logDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/WALs/jenkins-hbase20.apache.org,32897,1696273349258, archiveDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/oldWALs, maxLogs=32 2023-10-02 19:02:30,768 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39979,DS-5af15e73-a85b-45b6-8052-24e68f845077,DISK] 2023-10-02 19:02:30,768 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33791,DS-31e94e33-5a69-4f59-81ad-737a8ed61fa2,DISK] 2023-10-02 19:02:30,768 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45759,DS-1e0faf12-d660-4aa9-ac45-dc2a72769288,DISK] 2023-10-02 19:02:30,791 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39979,DS-5af15e73-a85b-45b6-8052-24e68f845077,DISK] 2023-10-02 19:02:30,793 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33791,DS-31e94e33-5a69-4f59-81ad-737a8ed61fa2,DISK] 2023-10-02 19:02:30,793 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33791,DS-31e94e33-5a69-4f59-81ad-737a8ed61fa2,DISK] 2023-10-02 19:02:30,794 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45759,DS-1e0faf12-d660-4aa9-ac45-dc2a72769288,DISK] 2023-10-02 19:02:30,794 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45759,DS-1e0faf12-d660-4aa9-ac45-dc2a72769288,DISK] 2023-10-02 19:02:30,796 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39979,DS-5af15e73-a85b-45b6-8052-24e68f845077,DISK] 2023-10-02 19:02:30,817 INFO [RS:2;jenkins-hbase20:32897] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/WALs/jenkins-hbase20.apache.org,32897,1696273349258/jenkins-hbase20.apache.org%2C32897%2C1696273349258.1696273350750 2023-10-02 19:02:30,818 DEBUG [RS:2;jenkins-hbase20:32897] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33791,DS-31e94e33-5a69-4f59-81ad-737a8ed61fa2,DISK], DatanodeInfoWithStorage[127.0.0.1:39979,DS-5af15e73-a85b-45b6-8052-24e68f845077,DISK], DatanodeInfoWithStorage[127.0.0.1:45759,DS-1e0faf12-d660-4aa9-ac45-dc2a72769288,DISK]] 2023-10-02 19:02:30,824 INFO [RS:0;jenkins-hbase20:34425] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/WALs/jenkins-hbase20.apache.org,34425,1696273349187/jenkins-hbase20.apache.org%2C34425%2C1696273349187.1696273350750 2023-10-02 19:02:30,824 INFO [RS:1;jenkins-hbase20:38887] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/WALs/jenkins-hbase20.apache.org,38887,1696273349229/jenkins-hbase20.apache.org%2C38887%2C1696273349229.1696273350750 2023-10-02 19:02:30,825 DEBUG [RS:0;jenkins-hbase20:34425] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39979,DS-5af15e73-a85b-45b6-8052-24e68f845077,DISK], DatanodeInfoWithStorage[127.0.0.1:33791,DS-31e94e33-5a69-4f59-81ad-737a8ed61fa2,DISK], DatanodeInfoWithStorage[127.0.0.1:45759,DS-1e0faf12-d660-4aa9-ac45-dc2a72769288,DISK]] 2023-10-02 19:02:30,825 DEBUG [RS:1;jenkins-hbase20:38887] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45759,DS-1e0faf12-d660-4aa9-ac45-dc2a72769288,DISK], DatanodeInfoWithStorage[127.0.0.1:39979,DS-5af15e73-a85b-45b6-8052-24e68f845077,DISK], DatanodeInfoWithStorage[127.0.0.1:33791,DS-31e94e33-5a69-4f59-81ad-737a8ed61fa2,DISK]] 2023-10-02 19:02:30,890 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:30,892 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-02 19:02:30,895 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:35044, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-02 19:02:30,908 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-10-02 19:02:30,908 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-02 19:02:30,912 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C38887%2C1696273349229.meta, suffix=.meta, logDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/WALs/jenkins-hbase20.apache.org,38887,1696273349229, archiveDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/oldWALs, maxLogs=32 2023-10-02 19:02:30,931 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39979,DS-5af15e73-a85b-45b6-8052-24e68f845077,DISK] 2023-10-02 19:02:30,932 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33791,DS-31e94e33-5a69-4f59-81ad-737a8ed61fa2,DISK] 2023-10-02 19:02:30,933 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45759,DS-1e0faf12-d660-4aa9-ac45-dc2a72769288,DISK] 2023-10-02 19:02:30,938 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/WALs/jenkins-hbase20.apache.org,38887,1696273349229/jenkins-hbase20.apache.org%2C38887%2C1696273349229.meta.1696273350913.meta 2023-10-02 19:02:30,938 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39979,DS-5af15e73-a85b-45b6-8052-24e68f845077,DISK], DatanodeInfoWithStorage[127.0.0.1:33791,DS-31e94e33-5a69-4f59-81ad-737a8ed61fa2,DISK], DatanodeInfoWithStorage[127.0.0.1:45759,DS-1e0faf12-d660-4aa9-ac45-dc2a72769288,DISK]] 2023-10-02 19:02:30,938 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-10-02 19:02:30,939 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-10-02 19:02:30,941 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 19:02:30,941 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-10-02 19:02:30,948 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-10-02 19:02:30,950 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-10-02 19:02:30,966 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-10-02 19:02:30,966 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:02:30,966 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-10-02 19:02:30,966 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-10-02 19:02:30,969 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-02 19:02:30,971 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/meta/1588230740/info 2023-10-02 19:02:30,971 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/meta/1588230740/info 2023-10-02 19:02:30,972 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-02 19:02:30,973 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 19:02:30,973 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-02 19:02:30,975 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/meta/1588230740/rep_barrier 2023-10-02 19:02:30,975 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/meta/1588230740/rep_barrier 2023-10-02 19:02:30,976 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-02 19:02:30,977 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 19:02:30,977 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-02 19:02:30,980 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/meta/1588230740/table 2023-10-02 19:02:30,980 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/meta/1588230740/table 2023-10-02 19:02:30,980 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-02 19:02:30,981 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 19:02:30,987 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/meta/1588230740 2023-10-02 19:02:30,991 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/meta/1588230740 2023-10-02 19:02:30,995 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-02 19:02:30,998 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-02 19:02:31,001 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71083154, jitterRate=0.0592215359210968}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-02 19:02:31,003 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-02 19:02:31,012 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1696273350884 2023-10-02 19:02:31,033 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-10-02 19:02:31,033 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-10-02 19:02:31,034 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,38887,1696273349229, state=OPEN 2023-10-02 19:02:31,037 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-10-02 19:02:31,037 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-02 19:02:31,041 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-10-02 19:02:31,041 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,38887,1696273349229 in 327 msec 2023-10-02 19:02:31,050 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-10-02 19:02:31,050 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 537 msec 2023-10-02 19:02:31,068 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 780 msec 2023-10-02 19:02:31,068 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1696273351068, completionTime=-1 2023-10-02 19:02:31,068 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-10-02 19:02:31,068 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-10-02 19:02:31,129 DEBUG [hconnection-0xb2bac33-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:02:31,133 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:35046, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:02:31,154 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-10-02 19:02:31,154 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1696273411154 2023-10-02 19:02:31,154 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1696273471154 2023-10-02 19:02:31,154 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 86 msec 2023-10-02 19:02:31,185 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,32777,1696273348175-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-02 19:02:31,185 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,32777,1696273348175-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-02 19:02:31,185 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,32777,1696273348175-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-02 19:02:31,187 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:32777, period=300000, unit=MILLISECONDS is enabled. 2023-10-02 19:02:31,187 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-10-02 19:02:31,193 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-10-02 19:02:31,201 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-10-02 19:02:31,202 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-02 19:02:31,211 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-10-02 19:02:31,214 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 19:02:31,216 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 19:02:31,236 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/hbase/namespace/b7cffa73bdab6c5883d5137f4c4dc219 2023-10-02 19:02:31,239 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/hbase/namespace/b7cffa73bdab6c5883d5137f4c4dc219 empty. 2023-10-02 19:02:31,240 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/hbase/namespace/b7cffa73bdab6c5883d5137f4c4dc219 2023-10-02 19:02:31,240 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-10-02 19:02:31,282 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-10-02 19:02:31,284 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => b7cffa73bdab6c5883d5137f4c4dc219, NAME => 'hbase:namespace,,1696273351202.b7cffa73bdab6c5883d5137f4c4dc219.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp 2023-10-02 19:02:31,303 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696273351202.b7cffa73bdab6c5883d5137f4c4dc219.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:02:31,304 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing b7cffa73bdab6c5883d5137f4c4dc219, disabling compactions & flushes 2023-10-02 19:02:31,304 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696273351202.b7cffa73bdab6c5883d5137f4c4dc219. 2023-10-02 19:02:31,304 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696273351202.b7cffa73bdab6c5883d5137f4c4dc219. 2023-10-02 19:02:31,304 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696273351202.b7cffa73bdab6c5883d5137f4c4dc219. after waiting 0 ms 2023-10-02 19:02:31,304 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696273351202.b7cffa73bdab6c5883d5137f4c4dc219. 2023-10-02 19:02:31,304 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696273351202.b7cffa73bdab6c5883d5137f4c4dc219. 2023-10-02 19:02:31,304 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for b7cffa73bdab6c5883d5137f4c4dc219: 2023-10-02 19:02:31,308 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 19:02:31,323 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1696273351202.b7cffa73bdab6c5883d5137f4c4dc219.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696273351312"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696273351312"}]},"ts":"1696273351312"} 2023-10-02 19:02:31,348 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-02 19:02:31,350 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 19:02:31,354 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696273351350"}]},"ts":"1696273351350"} 2023-10-02 19:02:31,360 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-10-02 19:02:31,364 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-10-02 19:02:31,365 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 19:02:31,365 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 19:02:31,365 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 19:02:31,365 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 19:02:31,367 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b7cffa73bdab6c5883d5137f4c4dc219, ASSIGN}] 2023-10-02 19:02:31,372 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b7cffa73bdab6c5883d5137f4c4dc219, ASSIGN 2023-10-02 19:02:31,374 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=b7cffa73bdab6c5883d5137f4c4dc219, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,32897,1696273349258; forceNewPlan=false, retain=false 2023-10-02 19:02:31,526 INFO [jenkins-hbase20:32777] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-02 19:02:31,527 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b7cffa73bdab6c5883d5137f4c4dc219, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:31,527 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1696273351202.b7cffa73bdab6c5883d5137f4c4dc219.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696273351527"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696273351527"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696273351527"}]},"ts":"1696273351527"} 2023-10-02 19:02:31,533 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure b7cffa73bdab6c5883d5137f4c4dc219, server=jenkins-hbase20.apache.org,32897,1696273349258}] 2023-10-02 19:02:31,688 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:31,688 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-02 19:02:31,692 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57838, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-02 19:02:31,698 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1696273351202.b7cffa73bdab6c5883d5137f4c4dc219. 2023-10-02 19:02:31,699 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b7cffa73bdab6c5883d5137f4c4dc219, NAME => 'hbase:namespace,,1696273351202.b7cffa73bdab6c5883d5137f4c4dc219.', STARTKEY => '', ENDKEY => ''} 2023-10-02 19:02:31,699 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1696273351202.b7cffa73bdab6c5883d5137f4c4dc219. service=AccessControlService 2023-10-02 19:02:31,700 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 19:02:31,700 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace b7cffa73bdab6c5883d5137f4c4dc219 2023-10-02 19:02:31,701 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696273351202.b7cffa73bdab6c5883d5137f4c4dc219.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:02:31,701 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for b7cffa73bdab6c5883d5137f4c4dc219 2023-10-02 19:02:31,701 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for b7cffa73bdab6c5883d5137f4c4dc219 2023-10-02 19:02:31,704 INFO [StoreOpener-b7cffa73bdab6c5883d5137f4c4dc219-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region b7cffa73bdab6c5883d5137f4c4dc219 2023-10-02 19:02:31,706 DEBUG [StoreOpener-b7cffa73bdab6c5883d5137f4c4dc219-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/namespace/b7cffa73bdab6c5883d5137f4c4dc219/info 2023-10-02 19:02:31,706 DEBUG [StoreOpener-b7cffa73bdab6c5883d5137f4c4dc219-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/namespace/b7cffa73bdab6c5883d5137f4c4dc219/info 2023-10-02 19:02:31,706 INFO [StoreOpener-b7cffa73bdab6c5883d5137f4c4dc219-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b7cffa73bdab6c5883d5137f4c4dc219 columnFamilyName info 2023-10-02 19:02:31,707 INFO [StoreOpener-b7cffa73bdab6c5883d5137f4c4dc219-1] regionserver.HStore(310): Store=b7cffa73bdab6c5883d5137f4c4dc219/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 19:02:31,710 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/namespace/b7cffa73bdab6c5883d5137f4c4dc219 2023-10-02 19:02:31,711 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/namespace/b7cffa73bdab6c5883d5137f4c4dc219 2023-10-02 19:02:31,715 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for b7cffa73bdab6c5883d5137f4c4dc219 2023-10-02 19:02:31,719 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/namespace/b7cffa73bdab6c5883d5137f4c4dc219/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 19:02:31,720 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened b7cffa73bdab6c5883d5137f4c4dc219; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72415010, jitterRate=0.07906773686408997}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 19:02:31,720 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for b7cffa73bdab6c5883d5137f4c4dc219: 2023-10-02 19:02:31,722 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1696273351202.b7cffa73bdab6c5883d5137f4c4dc219., pid=6, masterSystemTime=1696273351688 2023-10-02 19:02:31,727 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1696273351202.b7cffa73bdab6c5883d5137f4c4dc219. 2023-10-02 19:02:31,727 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1696273351202.b7cffa73bdab6c5883d5137f4c4dc219. 2023-10-02 19:02:31,729 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b7cffa73bdab6c5883d5137f4c4dc219, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:31,729 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1696273351202.b7cffa73bdab6c5883d5137f4c4dc219.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696273351728"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696273351728"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696273351728"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696273351728"}]},"ts":"1696273351728"} 2023-10-02 19:02:31,737 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-10-02 19:02:31,737 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure b7cffa73bdab6c5883d5137f4c4dc219, server=jenkins-hbase20.apache.org,32897,1696273349258 in 200 msec 2023-10-02 19:02:31,741 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-10-02 19:02:31,742 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=b7cffa73bdab6c5883d5137f4c4dc219, ASSIGN in 370 msec 2023-10-02 19:02:31,743 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 19:02:31,744 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696273351743"}]},"ts":"1696273351743"} 2023-10-02 19:02:31,747 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-10-02 19:02:31,750 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 19:02:31,754 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 547 msec 2023-10-02 19:02:31,813 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-10-02 19:02:31,814 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-10-02 19:02:31,814 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 19:02:31,835 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:02:31,837 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57854, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:02:31,849 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-10-02 19:02:31,868 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-02 19:02:31,874 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 30 msec 2023-10-02 19:02:31,883 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-10-02 19:02:31,894 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-02 19:02:31,899 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-10-02 19:02:31,910 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-10-02 19:02:31,912 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-10-02 19:02:31,912 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.595sec 2023-10-02 19:02:31,915 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-10-02 19:02:31,916 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-10-02 19:02:31,917 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-10-02 19:02:31,918 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,32777,1696273348175-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-10-02 19:02:31,918 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,32777,1696273348175-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-10-02 19:02:31,936 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-02 19:02:31,938 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-10-02 19:02:31,941 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 19:02:31,942 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 19:02:31,945 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-10-02 19:02:31,945 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/hbase/acl/8a36d99e5f9f38c7e20496d80c982ee4 2023-10-02 19:02:31,946 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/hbase/acl/8a36d99e5f9f38c7e20496d80c982ee4 empty. 2023-10-02 19:02:31,949 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/hbase/acl/8a36d99e5f9f38c7e20496d80c982ee4 2023-10-02 19:02:31,949 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-10-02 19:02:31,980 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-02 19:02:31,994 DEBUG [Listener at localhost/36391] zookeeper.ReadOnlyZKClient(139): Connect 0x79e803a7 to 127.0.0.1:60248 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 19:02:32,000 DEBUG [Listener at localhost/36391] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f910a43, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 19:02:32,001 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-10-02 19:02:32,004 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8a36d99e5f9f38c7e20496d80c982ee4, NAME => 'hbase:acl,,1696273351933.8a36d99e5f9f38c7e20496d80c982ee4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp 2023-10-02 19:02:32,016 DEBUG [hconnection-0x51de1744-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:02:32,033 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696273351933.8a36d99e5f9f38c7e20496d80c982ee4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:02:32,034 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 8a36d99e5f9f38c7e20496d80c982ee4, disabling compactions & flushes 2023-10-02 19:02:32,034 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696273351933.8a36d99e5f9f38c7e20496d80c982ee4. 2023-10-02 19:02:32,034 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696273351933.8a36d99e5f9f38c7e20496d80c982ee4. 2023-10-02 19:02:32,034 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696273351933.8a36d99e5f9f38c7e20496d80c982ee4. after waiting 0 ms 2023-10-02 19:02:32,034 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696273351933.8a36d99e5f9f38c7e20496d80c982ee4. 2023-10-02 19:02:32,034 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1696273351933.8a36d99e5f9f38c7e20496d80c982ee4. 2023-10-02 19:02:32,034 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 8a36d99e5f9f38c7e20496d80c982ee4: 2023-10-02 19:02:32,038 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:35048, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:02:32,039 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 19:02:32,040 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1696273351933.8a36d99e5f9f38c7e20496d80c982ee4.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696273352040"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696273352040"}]},"ts":"1696273352040"} 2023-10-02 19:02:32,040 INFO [Listener at localhost/36391] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,32777,1696273348175 2023-10-02 19:02:32,040 INFO [Listener at localhost/36391] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-10-02 19:02:32,041 INFO [Listener at localhost/36391] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/test.cache.data in system properties and HBase conf 2023-10-02 19:02:32,041 INFO [Listener at localhost/36391] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/hadoop.tmp.dir in system properties and HBase conf 2023-10-02 19:02:32,041 INFO [Listener at localhost/36391] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/hadoop.log.dir in system properties and HBase conf 2023-10-02 19:02:32,041 INFO [Listener at localhost/36391] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-02 19:02:32,041 INFO [Listener at localhost/36391] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-02 19:02:32,041 INFO [Listener at localhost/36391] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-02 19:02:32,041 INFO [Listener at localhost/36391] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-02 19:02:32,042 INFO [Listener at localhost/36391] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-02 19:02:32,042 INFO [Listener at localhost/36391] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-02 19:02:32,042 INFO [Listener at localhost/36391] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-02 19:02:32,042 INFO [Listener at localhost/36391] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-02 19:02:32,042 INFO [Listener at localhost/36391] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-02 19:02:32,042 INFO [Listener at localhost/36391] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-02 19:02:32,042 INFO [Listener at localhost/36391] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-02 19:02:32,042 INFO [Listener at localhost/36391] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-02 19:02:32,042 INFO [Listener at localhost/36391] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/nfs.dump.dir in system properties and HBase conf 2023-10-02 19:02:32,042 INFO [Listener at localhost/36391] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/java.io.tmpdir in system properties and HBase conf 2023-10-02 19:02:32,042 INFO [Listener at localhost/36391] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-02 19:02:32,042 INFO [Listener at localhost/36391] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-02 19:02:32,042 INFO [Listener at localhost/36391] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-10-02 19:02:32,046 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-02 19:02:32,048 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 19:02:32,048 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696273352048"}]},"ts":"1696273352048"} 2023-10-02 19:02:32,050 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-10-02 19:02:32,054 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-10-02 19:02:32,055 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 19:02:32,055 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 19:02:32,055 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 19:02:32,055 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 19:02:32,055 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=8a36d99e5f9f38c7e20496d80c982ee4, ASSIGN}] 2023-10-02 19:02:32,057 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=8a36d99e5f9f38c7e20496d80c982ee4, ASSIGN 2023-10-02 19:02:32,059 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=8a36d99e5f9f38c7e20496d80c982ee4, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34425,1696273349187; forceNewPlan=false, retain=false 2023-10-02 19:02:32,086 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-02 19:02:32,209 INFO [jenkins-hbase20:32777] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-02 19:02:32,210 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=8a36d99e5f9f38c7e20496d80c982ee4, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:32,211 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1696273351933.8a36d99e5f9f38c7e20496d80c982ee4.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696273352210"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696273352210"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696273352210"}]},"ts":"1696273352210"} 2023-10-02 19:02:32,214 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 8a36d99e5f9f38c7e20496d80c982ee4, server=jenkins-hbase20.apache.org,34425,1696273349187}] 2023-10-02 19:02:32,286 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-02 19:02:32,369 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:32,369 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-02 19:02:32,373 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50210, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-02 19:02:32,379 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1696273351933.8a36d99e5f9f38c7e20496d80c982ee4. 2023-10-02 19:02:32,380 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8a36d99e5f9f38c7e20496d80c982ee4, NAME => 'hbase:acl,,1696273351933.8a36d99e5f9f38c7e20496d80c982ee4.', STARTKEY => '', ENDKEY => ''} 2023-10-02 19:02:32,380 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1696273351933.8a36d99e5f9f38c7e20496d80c982ee4. service=AccessControlService 2023-10-02 19:02:32,380 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 19:02:32,381 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 8a36d99e5f9f38c7e20496d80c982ee4 2023-10-02 19:02:32,381 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696273351933.8a36d99e5f9f38c7e20496d80c982ee4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:02:32,381 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 8a36d99e5f9f38c7e20496d80c982ee4 2023-10-02 19:02:32,381 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 8a36d99e5f9f38c7e20496d80c982ee4 2023-10-02 19:02:32,383 INFO [StoreOpener-8a36d99e5f9f38c7e20496d80c982ee4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 8a36d99e5f9f38c7e20496d80c982ee4 2023-10-02 19:02:32,387 DEBUG [StoreOpener-8a36d99e5f9f38c7e20496d80c982ee4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/acl/8a36d99e5f9f38c7e20496d80c982ee4/l 2023-10-02 19:02:32,387 DEBUG [StoreOpener-8a36d99e5f9f38c7e20496d80c982ee4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/acl/8a36d99e5f9f38c7e20496d80c982ee4/l 2023-10-02 19:02:32,387 INFO [StoreOpener-8a36d99e5f9f38c7e20496d80c982ee4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a36d99e5f9f38c7e20496d80c982ee4 columnFamilyName l 2023-10-02 19:02:32,388 INFO [StoreOpener-8a36d99e5f9f38c7e20496d80c982ee4-1] regionserver.HStore(310): Store=8a36d99e5f9f38c7e20496d80c982ee4/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 19:02:32,391 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/acl/8a36d99e5f9f38c7e20496d80c982ee4 2023-10-02 19:02:32,392 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/acl/8a36d99e5f9f38c7e20496d80c982ee4 2023-10-02 19:02:32,397 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 8a36d99e5f9f38c7e20496d80c982ee4 2023-10-02 19:02:32,401 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/acl/8a36d99e5f9f38c7e20496d80c982ee4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 19:02:32,402 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 8a36d99e5f9f38c7e20496d80c982ee4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59930768, jitterRate=-0.10696196556091309}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 19:02:32,402 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 8a36d99e5f9f38c7e20496d80c982ee4: 2023-10-02 19:02:32,404 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1696273351933.8a36d99e5f9f38c7e20496d80c982ee4., pid=11, masterSystemTime=1696273352369 2023-10-02 19:02:32,408 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1696273351933.8a36d99e5f9f38c7e20496d80c982ee4. 2023-10-02 19:02:32,408 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1696273351933.8a36d99e5f9f38c7e20496d80c982ee4. 2023-10-02 19:02:32,410 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=8a36d99e5f9f38c7e20496d80c982ee4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:32,410 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1696273351933.8a36d99e5f9f38c7e20496d80c982ee4.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696273352409"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696273352409"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696273352409"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696273352409"}]},"ts":"1696273352409"} 2023-10-02 19:02:32,416 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-10-02 19:02:32,416 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 8a36d99e5f9f38c7e20496d80c982ee4, server=jenkins-hbase20.apache.org,34425,1696273349187 in 199 msec 2023-10-02 19:02:32,421 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-10-02 19:02:32,421 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=8a36d99e5f9f38c7e20496d80c982ee4, ASSIGN in 361 msec 2023-10-02 19:02:32,423 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 19:02:32,423 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696273352423"}]},"ts":"1696273352423"} 2023-10-02 19:02:32,425 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-10-02 19:02:32,428 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 19:02:32,431 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 491 msec 2023-10-02 19:02:32,586 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-02 19:02:32,587 INFO [master/jenkins-hbase20:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-10-02 19:02:32,597 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-10-02 19:02:33,156 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-02 19:02:33,471 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-10-02 19:02:33,477 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_35031_jobhistory____itpx9l/webapp 2023-10-02 19:02:33,614 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-10-02 19:02:33,614 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-10-02 19:02:33,614 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-02 19:02:33,617 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-02 19:02:33,690 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 19:02:33,971 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 19:02:34,239 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-10-02 19:02:34,272 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:35031 2023-10-02 19:02:34,637 WARN [Listener at jenkins-hbase20.apache.org/39431] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-02 19:02:34,886 WARN [Listener at jenkins-hbase20.apache.org/39431] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-02 19:02:34,887 INFO [Listener at jenkins-hbase20.apache.org/39431] log.Slf4jLog(67): jetty-6.1.26 2023-10-02 19:02:34,893 INFO [Listener at jenkins-hbase20.apache.org/39431] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_39987_cluster____xjup32/webapp 2023-10-02 19:02:34,954 INFO [Listener at jenkins-hbase20.apache.org/39431] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-10-02 19:02:34,954 INFO [Listener at jenkins-hbase20.apache.org/39431] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-10-02 19:02:34,954 INFO [Listener at jenkins-hbase20.apache.org/39431] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-02 19:02:34,955 INFO [Listener at jenkins-hbase20.apache.org/39431] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-02 19:02:34,963 INFO [Listener at jenkins-hbase20.apache.org/39431] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 19:02:35,167 INFO [Listener at jenkins-hbase20.apache.org/39431] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 19:02:35,291 INFO [Listener at jenkins-hbase20.apache.org/39431] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 19:02:35,301 INFO [Listener at jenkins-hbase20.apache.org/39431] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:39987 2023-10-02 19:02:35,741 WARN [Listener at jenkins-hbase20.apache.org/42069] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-02 19:02:35,763 WARN [Listener at jenkins-hbase20.apache.org/42069] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-02 19:02:35,764 INFO [Listener at jenkins-hbase20.apache.org/42069] log.Slf4jLog(67): jetty-6.1.26 2023-10-02 19:02:35,770 INFO [Listener at jenkins-hbase20.apache.org/42069] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_35035_node____.610kla/webapp 2023-10-02 19:02:35,812 INFO [Listener at jenkins-hbase20.apache.org/42069] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-02 19:02:35,812 INFO [Listener at jenkins-hbase20.apache.org/42069] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-02 19:02:35,812 INFO [Listener at jenkins-hbase20.apache.org/42069] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-02 19:02:35,812 INFO [Listener at jenkins-hbase20.apache.org/42069] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-02 19:02:35,820 INFO [Listener at jenkins-hbase20.apache.org/42069] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 19:02:35,846 INFO [Listener at jenkins-hbase20.apache.org/42069] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 19:02:35,918 INFO [Listener at jenkins-hbase20.apache.org/42069] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 19:02:35,928 INFO [Listener at jenkins-hbase20.apache.org/42069] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:35035 2023-10-02 19:02:36,120 WARN [Listener at jenkins-hbase20.apache.org/42825] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-02 19:02:36,129 WARN [Listener at jenkins-hbase20.apache.org/42825] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-02 19:02:36,129 INFO [Listener at jenkins-hbase20.apache.org/42825] log.Slf4jLog(67): jetty-6.1.26 2023-10-02 19:02:36,139 INFO [Listener at jenkins-hbase20.apache.org/42825] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_41163_node____w99er/webapp 2023-10-02 19:02:36,194 INFO [Listener at jenkins-hbase20.apache.org/42825] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-02 19:02:36,194 INFO [Listener at jenkins-hbase20.apache.org/42825] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-02 19:02:36,194 INFO [Listener at jenkins-hbase20.apache.org/42825] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-02 19:02:36,194 INFO [Listener at jenkins-hbase20.apache.org/42825] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-02 19:02:36,201 INFO [Listener at jenkins-hbase20.apache.org/42825] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 19:02:36,214 INFO [Listener at jenkins-hbase20.apache.org/42825] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 19:02:36,272 INFO [Listener at jenkins-hbase20.apache.org/42825] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 19:02:36,279 INFO [Listener at jenkins-hbase20.apache.org/42825] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:41163 2023-10-02 19:02:36,307 INFO [Listener at jenkins-hbase20.apache.org/42825] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-10-02 19:02:36,309 INFO [Listener at jenkins-hbase20.apache.org/42825] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 19:02:36,374 INFO [Listener at jenkins-hbase20.apache.org/42825] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=709, OpenFileDescriptor=901, MaxFileDescriptor=60000, SystemLoadAverage=170, ProcessCount=165, AvailableMemoryMB=5729 2023-10-02 19:02:36,374 WARN [Listener at jenkins-hbase20.apache.org/42825] hbase.ResourceChecker(130): Thread=709 is superior to 500 2023-10-02 19:02:36,389 DEBUG [Listener at jenkins-hbase20.apache.org/42825] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-02 19:02:36,395 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60132, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-02 19:02:36,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-02 19:02:36,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-10-02 19:02:36,406 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 19:02:36,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-10-02 19:02:36,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-02 19:02:36,411 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 19:02:36,415 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportWithTargetName/5a48abaa29ede66a105a114b780213ab 2023-10-02 19:02:36,415 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportWithTargetName/88fbff4be96039143c55e4c759df8f16 2023-10-02 19:02:36,417 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportWithTargetName/5a48abaa29ede66a105a114b780213ab empty. 2023-10-02 19:02:36,417 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportWithTargetName/88fbff4be96039143c55e4c759df8f16 empty. 2023-10-02 19:02:36,418 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportWithTargetName/5a48abaa29ede66a105a114b780213ab 2023-10-02 19:02:36,418 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportWithTargetName/88fbff4be96039143c55e4c759df8f16 2023-10-02 19:02:36,418 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-02 19:02:36,448 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-10-02 19:02:36,450 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5a48abaa29ede66a105a114b780213ab, NAME => 'testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp 2023-10-02 19:02:36,450 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 88fbff4be96039143c55e4c759df8f16, NAME => 'testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp 2023-10-02 19:02:36,481 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:02:36,481 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 88fbff4be96039143c55e4c759df8f16, disabling compactions & flushes 2023-10-02 19:02:36,481 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16. 2023-10-02 19:02:36,481 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16. 2023-10-02 19:02:36,481 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16. after waiting 0 ms 2023-10-02 19:02:36,481 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16. 2023-10-02 19:02:36,481 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16. 2023-10-02 19:02:36,481 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 88fbff4be96039143c55e4c759df8f16: 2023-10-02 19:02:36,484 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:02:36,485 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 5a48abaa29ede66a105a114b780213ab, disabling compactions & flushes 2023-10-02 19:02:36,485 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab. 2023-10-02 19:02:36,485 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab. 2023-10-02 19:02:36,485 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab. after waiting 0 ms 2023-10-02 19:02:36,485 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab. 2023-10-02 19:02:36,485 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab. 2023-10-02 19:02:36,485 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 5a48abaa29ede66a105a114b780213ab: 2023-10-02 19:02:36,490 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 19:02:36,491 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696273356491"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696273356491"}]},"ts":"1696273356491"} 2023-10-02 19:02:36,492 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696273356491"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696273356491"}]},"ts":"1696273356491"} 2023-10-02 19:02:36,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-02 19:02:36,530 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-02 19:02:36,532 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 19:02:36,533 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696273356532"}]},"ts":"1696273356532"} 2023-10-02 19:02:36,535 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-10-02 19:02:36,537 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-02 19:02:36,539 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-10-02 19:02:36,540 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 19:02:36,540 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 19:02:36,540 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 19:02:36,540 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 19:02:36,541 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5a48abaa29ede66a105a114b780213ab, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=88fbff4be96039143c55e4c759df8f16, ASSIGN}] 2023-10-02 19:02:36,544 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=88fbff4be96039143c55e4c759df8f16, ASSIGN 2023-10-02 19:02:36,544 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5a48abaa29ede66a105a114b780213ab, ASSIGN 2023-10-02 19:02:36,545 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5a48abaa29ede66a105a114b780213ab, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34425,1696273349187; forceNewPlan=false, retain=false 2023-10-02 19:02:36,545 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=88fbff4be96039143c55e4c759df8f16, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,32897,1696273349258; forceNewPlan=false, retain=false 2023-10-02 19:02:36,696 INFO [jenkins-hbase20:32777] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-02 19:02:36,698 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-10-02 19:02:36,698 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=88fbff4be96039143c55e4c759df8f16, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:36,698 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=5a48abaa29ede66a105a114b780213ab, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:36,698 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696273356698"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696273356698"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696273356698"}]},"ts":"1696273356698"} 2023-10-02 19:02:36,698 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696273356698"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696273356698"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696273356698"}]},"ts":"1696273356698"} 2023-10-02 19:02:36,699 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-10-02 19:02:36,700 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-10-02 19:02:36,702 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 88fbff4be96039143c55e4c759df8f16, server=jenkins-hbase20.apache.org,32897,1696273349258}] 2023-10-02 19:02:36,704 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 5a48abaa29ede66a105a114b780213ab, server=jenkins-hbase20.apache.org,34425,1696273349187}] 2023-10-02 19:02:36,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-02 19:02:36,866 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16. 2023-10-02 19:02:36,866 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab. 2023-10-02 19:02:36,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 88fbff4be96039143c55e4c759df8f16, NAME => 'testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16.', STARTKEY => '1', ENDKEY => ''} 2023-10-02 19:02:36,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5a48abaa29ede66a105a114b780213ab, NAME => 'testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab.', STARTKEY => '', ENDKEY => '1'} 2023-10-02 19:02:36,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab. service=AccessControlService 2023-10-02 19:02:36,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16. service=AccessControlService 2023-10-02 19:02:36,867 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 19:02:36,867 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 19:02:36,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 5a48abaa29ede66a105a114b780213ab 2023-10-02 19:02:36,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 88fbff4be96039143c55e4c759df8f16 2023-10-02 19:02:36,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:02:36,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:02:36,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 5a48abaa29ede66a105a114b780213ab 2023-10-02 19:02:36,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 88fbff4be96039143c55e4c759df8f16 2023-10-02 19:02:36,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 5a48abaa29ede66a105a114b780213ab 2023-10-02 19:02:36,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 88fbff4be96039143c55e4c759df8f16 2023-10-02 19:02:36,875 INFO [StoreOpener-88fbff4be96039143c55e4c759df8f16-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 88fbff4be96039143c55e4c759df8f16 2023-10-02 19:02:36,875 INFO [StoreOpener-5a48abaa29ede66a105a114b780213ab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5a48abaa29ede66a105a114b780213ab 2023-10-02 19:02:36,877 DEBUG [StoreOpener-88fbff4be96039143c55e4c759df8f16-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportWithTargetName/88fbff4be96039143c55e4c759df8f16/cf 2023-10-02 19:02:36,877 DEBUG [StoreOpener-5a48abaa29ede66a105a114b780213ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportWithTargetName/5a48abaa29ede66a105a114b780213ab/cf 2023-10-02 19:02:36,877 DEBUG [StoreOpener-88fbff4be96039143c55e4c759df8f16-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportWithTargetName/88fbff4be96039143c55e4c759df8f16/cf 2023-10-02 19:02:36,877 DEBUG [StoreOpener-5a48abaa29ede66a105a114b780213ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportWithTargetName/5a48abaa29ede66a105a114b780213ab/cf 2023-10-02 19:02:36,881 INFO [StoreOpener-5a48abaa29ede66a105a114b780213ab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a48abaa29ede66a105a114b780213ab columnFamilyName cf 2023-10-02 19:02:36,881 INFO [StoreOpener-88fbff4be96039143c55e4c759df8f16-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 88fbff4be96039143c55e4c759df8f16 columnFamilyName cf 2023-10-02 19:02:36,884 INFO [StoreOpener-88fbff4be96039143c55e4c759df8f16-1] regionserver.HStore(310): Store=88fbff4be96039143c55e4c759df8f16/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 19:02:36,884 INFO [StoreOpener-5a48abaa29ede66a105a114b780213ab-1] regionserver.HStore(310): Store=5a48abaa29ede66a105a114b780213ab/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 19:02:36,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportWithTargetName/5a48abaa29ede66a105a114b780213ab 2023-10-02 19:02:36,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportWithTargetName/88fbff4be96039143c55e4c759df8f16 2023-10-02 19:02:36,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportWithTargetName/5a48abaa29ede66a105a114b780213ab 2023-10-02 19:02:36,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportWithTargetName/88fbff4be96039143c55e4c759df8f16 2023-10-02 19:02:36,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 5a48abaa29ede66a105a114b780213ab 2023-10-02 19:02:36,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 88fbff4be96039143c55e4c759df8f16 2023-10-02 19:02:36,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportWithTargetName/5a48abaa29ede66a105a114b780213ab/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 19:02:36,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportWithTargetName/88fbff4be96039143c55e4c759df8f16/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 19:02:36,900 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 5a48abaa29ede66a105a114b780213ab; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65734086, jitterRate=-0.020485788583755493}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 19:02:36,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 5a48abaa29ede66a105a114b780213ab: 2023-10-02 19:02:36,901 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 88fbff4be96039143c55e4c759df8f16; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68389776, jitterRate=0.01908707618713379}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 19:02:36,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 88fbff4be96039143c55e4c759df8f16: 2023-10-02 19:02:36,902 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab., pid=16, masterSystemTime=1696273356857 2023-10-02 19:02:36,903 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16., pid=15, masterSystemTime=1696273356854 2023-10-02 19:02:36,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab. 2023-10-02 19:02:36,905 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab. 2023-10-02 19:02:36,906 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=5a48abaa29ede66a105a114b780213ab, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:36,907 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696273356906"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696273356906"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696273356906"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696273356906"}]},"ts":"1696273356906"} 2023-10-02 19:02:36,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16. 2023-10-02 19:02:36,908 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16. 2023-10-02 19:02:36,908 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=88fbff4be96039143c55e4c759df8f16, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:36,910 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696273356908"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696273356908"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696273356908"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696273356908"}]},"ts":"1696273356908"} 2023-10-02 19:02:36,915 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=13 2023-10-02 19:02:36,915 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 5a48abaa29ede66a105a114b780213ab, server=jenkins-hbase20.apache.org,34425,1696273349187 in 208 msec 2023-10-02 19:02:36,917 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-10-02 19:02:36,918 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 88fbff4be96039143c55e4c759df8f16, server=jenkins-hbase20.apache.org,32897,1696273349258 in 211 msec 2023-10-02 19:02:36,919 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5a48abaa29ede66a105a114b780213ab, ASSIGN in 374 msec 2023-10-02 19:02:36,922 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=12 2023-10-02 19:02:36,922 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=88fbff4be96039143c55e4c759df8f16, ASSIGN in 377 msec 2023-10-02 19:02:36,923 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 19:02:36,923 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696273356923"}]},"ts":"1696273356923"} 2023-10-02 19:02:36,926 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-10-02 19:02:36,929 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 19:02:36,934 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-10-02 19:02:36,939 DEBUG [PEWorker-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:02:36,943 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50226, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:02:36,947 DEBUG [hconnection-0xea52178-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:02:36,950 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58888, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-10-02 19:02:36,957 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34425] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-02 19:02:36,982 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-02 19:02:36,982 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-02 19:02:36,982 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-02 19:02:36,982 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-02 19:02:36,982 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 19:02:36,988 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-02 19:02:36,988 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-02 19:02:36,988 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-02 19:02:36,988 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-02 19:02:36,992 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 587 msec 2023-10-02 19:02:37,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-02 19:02:37,015 INFO [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-10-02 19:02:37,019 DEBUG [Listener at jenkins-hbase20.apache.org/42825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-02 19:02:37,020 DEBUG [Listener at jenkins-hbase20.apache.org/42825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab. 2023-10-02 19:02:37,022 INFO [Listener at jenkins-hbase20.apache.org/42825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 19:02:37,044 DEBUG [hconnection-0x51de1744-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:02:37,047 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50240, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:02:37,050 DEBUG [hconnection-0x51de1744-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:02:37,054 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38598, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:02:37,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-02 19:02:37,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696273357069 (current time:1696273357069). 2023-10-02 19:02:37,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 19:02:37,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(139): Connect 0x3504e6fc to 127.0.0.1:60248 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 19:02:37,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c19e379, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 19:02:37,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:02:37,082 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58890, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:02:37,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3504e6fc to 127.0.0.1:60248 2023-10-02 19:02:37,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:02:37,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(139): Connect 0x092ff55d to 127.0.0.1:60248 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 19:02:37,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2949fd79, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 19:02:37,104 DEBUG [hconnection-0x7efce902-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:02:37,105 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58906, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:02:37,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:02:37,112 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:02:37,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x092ff55d to 127.0.0.1:60248 2023-10-02 19:02:37,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:02:37,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-02 19:02:37,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 19:02:37,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-02 19:02:37,148 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot, current working dir path: hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 19:02:37,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-02 19:02:37,166 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-02 19:02:37,167 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696273957167 2023-10-02 19:02:37,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-02 19:02:37,167 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-02 19:02:37,170 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-02 19:02:37,171 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-02 19:02:37,172 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 12 msec 2023-10-02 19:02:37,173 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-02 19:02:37,175 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696273957175 2023-10-02 19:02:37,175 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 19:02:37,176 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 19:02:37,199 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,200 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-10-02 19:02:37,200 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:02:37,200 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-10-02 19:02:37,201 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-02 19:02:37,201 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,202 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,204 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:02:37,204 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,204 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:02:37,204 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:02:37,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:02:37,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:02:37,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:02:37,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:02:37,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:02:37,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:02:37,204 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,205 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,205 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,205 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,205 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,205 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 19:02:37,205 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-02 19:02:37,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-02 19:02:37,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-02 19:02:37,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,207 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-02 19:02:37,207 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-02 19:02:37,207 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-02 19:02:37,209 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,209 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,209 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,210 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-02 19:02:37,210 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-02 19:02:37,210 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:02:37,210 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:02:37,211 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-02 19:02:37,212 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-02 19:02:37,212 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-02 19:02:37,210 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-02 19:02:37,212 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:02:37,212 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34425,1696273349187' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-02 19:02:37,212 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-02 19:02:37,213 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,32897,1696273349258' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-02 19:02:37,213 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-02 19:02:37,213 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-02 19:02:37,213 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38887,1696273349229' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-02 19:02:37,224 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,224 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,224 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,224 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:02:37,224 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:02:37,224 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,224 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:02:37,224 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,224 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:02:37,224 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,225 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:02:37,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:02:37,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:02:37,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:37,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:02:37,227 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,32897,1696273349258' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-02 19:02:37,227 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2307bb31[Count = 1] remaining members to acquire global barrier 2023-10-02 19:02:37,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:02:37,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:02:37,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:02:37,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:02:37,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:37,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:02:37,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34425,1696273349187' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-02 19:02:37,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2307bb31[Count = 0] remaining members to acquire global barrier 2023-10-02 19:02:37,230 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-02 19:02:37,230 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,232 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,232 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,232 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,232 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,232 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-02 19:02:37,232 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-02 19:02:37,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,232 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-02 19:02:37,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,232 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,38887,1696273349229' in zk 2023-10-02 19:02:37,232 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,232 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-02 19:02:37,233 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 19:02:37,234 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-02 19:02:37,235 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:02:37,235 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-02 19:02:37,239 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 19:02:37,239 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab. 2023-10-02 19:02:37,239 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16. 2023-10-02 19:02:37,239 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 19:02:37,240 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 19:02:37,239 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 19:02:37,240 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16. started... 2023-10-02 19:02:37,240 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab. started... 2023-10-02 19:02:37,242 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 88fbff4be96039143c55e4c759df8f16: 2023-10-02 19:02:37,242 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5a48abaa29ede66a105a114b780213ab: 2023-10-02 19:02:37,243 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,243 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,249 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 19:02:37,249 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 19:02:37,252 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 19:02:37,252 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 19:02:37,276 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 19:02:37,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-02 19:02:37,285 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab. completed. 2023-10-02 19:02:37,285 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab. 2023-10-02 19:02:37,286 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 19:02:37,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-02 19:02:37,286 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 19:02:37,286 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,286 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-02 19:02:37,286 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,34425,1696273349187' in zk 2023-10-02 19:02:37,287 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 19:02:37,288 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16. completed. 2023-10-02 19:02:37,288 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-02 19:02:37,288 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16. 2023-10-02 19:02:37,288 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,288 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:02:37,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:02:37,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:02:37,288 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-02 19:02:37,288 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 19:02:37,289 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 19:02:37,289 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,289 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-02 19:02:37,289 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,32897,1696273349258' in zk 2023-10-02 19:02:37,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:02:37,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:02:37,291 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,291 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-02 19:02:37,291 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:02:37,291 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-02 19:02:37,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:37,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:02:37,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:37,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,34425,1696273349187': 2023-10-02 19:02:37,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34425,1696273349187' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-02 19:02:37,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:02:37,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:02:37,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:02:37,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:02:37,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:37,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:02:37,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:37,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,32897,1696273349258': 2023-10-02 19:02:37,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,32897,1696273349258' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-02 19:02:37,300 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-10-02 19:02:37,300 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 19:02:37,300 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 19:02:37,300 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,300 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 19:02:37,307 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,307 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,307 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,307 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,307 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:02:37,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:02:37,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:02:37,307 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:02:37,308 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,307 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:02:37,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:02:37,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:02:37,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:02:37,308 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:37,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:02:37,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:02:37,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:02:37,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:02:37,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,309 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:02:37,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:37,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:02:37,311 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,311 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:37,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,311 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:37,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,322 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:02:37,322 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:02:37,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:02:37,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:02:37,322 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:02:37,322 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,322 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:02:37,322 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,322 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:02:37,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:02:37,322 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:37,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:02:37,322 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:02:37,322 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:02:37,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:02:37,322 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:02:37,322 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:02:37,324 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:02:37,323 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-02 19:02:37,324 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,324 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,324 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,324 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:37,324 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 19:02:37,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:02:37,324 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:02:37,324 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,324 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:02:37,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:02:37,325 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-02 19:02:37,343 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,345 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,399 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,400 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-02 19:02:37,401 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,401 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:37,402 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696273357167Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696273357342 (+175 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1696273357343 (+1 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1696273357343Writing data manifest for emptySnaptb0-testExportWithTargetName at 1696273357358 (+15 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1696273357387 (+29 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696273357400 (+13 ms) 2023-10-02 19:02:37,403 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-02 19:02:37,406 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 235 msec 2023-10-02 19:02:37,487 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 19:02:37,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-02 19:02:37,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 19:02:37,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34425] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 19:02:37,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32897] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 19:02:37,511 DEBUG [Listener at jenkins-hbase20.apache.org/42825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-02 19:02:37,511 DEBUG [Listener at jenkins-hbase20.apache.org/42825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab. 2023-10-02 19:02:37,511 INFO [Listener at jenkins-hbase20.apache.org/42825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 19:02:37,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-02 19:02:37,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696273357530 (current time:1696273357530). 2023-10-02 19:02:37,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 19:02:37,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(139): Connect 0x14ed4cd9 to 127.0.0.1:60248 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 19:02:37,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@262d6ad1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 19:02:37,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:02:37,541 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:02:37,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x14ed4cd9 to 127.0.0.1:60248 2023-10-02 19:02:37,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:02:37,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(139): Connect 0x7bc1611b to 127.0.0.1:60248 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 19:02:37,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b4713e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 19:02:37,553 DEBUG [hconnection-0x4882e8bb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:02:37,556 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58928, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:02:37,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:02:37,563 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50260, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:02:37,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7bc1611b to 127.0.0.1:60248 2023-10-02 19:02:37,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:02:37,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-02 19:02:37,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 19:02:37,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-02 19:02:37,569 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot, current working dir path: hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 19:02:37,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-02 19:02:37,572 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-02 19:02:37,573 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696273957573 2023-10-02 19:02:37,573 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-02 19:02:37,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-02 19:02:37,576 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 19:02:37,576 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 19:02:37,576 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-02 19:02:37,577 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-02 19:02:37,580 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 9 msec 2023-10-02 19:02:37,581 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-02 19:02:37,582 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696273957582 2023-10-02 19:02:37,602 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-10-02 19:02:37,602 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-10-02 19:02:37,602 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:02:37,603 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-10-02 19:02:37,603 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-02 19:02:37,604 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,604 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,604 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:02:37,604 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:02:37,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:02:37,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:02:37,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:02:37,604 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,604 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:02:37,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:02:37,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:02:37,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:02:37,605 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,605 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,605 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,606 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,606 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,606 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,606 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 19:02:37,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-02 19:02:37,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-02 19:02:37,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-02 19:02:37,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,606 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-02 19:02:37,606 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-02 19:02:37,606 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-02 19:02:37,606 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-02 19:02:37,606 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-02 19:02:37,607 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-02 19:02:37,607 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-02 19:02:37,606 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-02 19:02:37,610 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:02:37,610 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-02 19:02:37,611 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-02 19:02:37,611 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-02 19:02:37,611 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,32897,1696273349258' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-02 19:02:37,611 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:02:37,610 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:02:37,612 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-02 19:02:37,612 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-02 19:02:37,612 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-02 19:02:37,612 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-02 19:02:37,612 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34425,1696273349187' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-02 19:02:37,613 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38887,1696273349229' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-02 19:02:37,617 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,617 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:02:37,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:02:37,618 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,618 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,618 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,618 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,618 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:02:37,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:02:37,618 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,618 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:02:37,618 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,618 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:02:37,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:02:37,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 19:02:37,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:37,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:02:37,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,32897,1696273349258' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-02 19:02:37,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5867948e[Count = 1] remaining members to acquire global barrier 2023-10-02 19:02:37,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:02:37,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:02:37,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:02:37,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:02:37,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 19:02:37,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:37,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:02:37,623 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34425,1696273349187' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-02 19:02:37,623 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5867948e[Count = 0] remaining members to acquire global barrier 2023-10-02 19:02:37,623 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-02 19:02:37,623 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,625 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,625 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,625 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,625 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,625 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-02 19:02:37,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,625 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-02 19:02:37,625 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-02 19:02:37,625 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,625 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 19:02:37,625 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,38887,1696273349229' in zk 2023-10-02 19:02:37,625 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-02 19:02:37,625 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 19:02:37,625 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 19:02:37,625 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 19:02:37,626 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 19:02:37,625 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16. 2023-10-02 19:02:37,626 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab. 2023-10-02 19:02:37,626 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab. started... 2023-10-02 19:02:37,626 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16. started... 2023-10-02 19:02:37,626 INFO [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5a48abaa29ede66a105a114b780213ab 1/1 column families, dataSize=199 B heapSize=688 B 2023-10-02 19:02:37,626 INFO [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 88fbff4be96039143c55e4c759df8f16 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-10-02 19:02:37,627 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-02 19:02:37,628 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:02:37,628 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-02 19:02:37,676 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 19:02:37,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-02 19:02:37,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-02 19:02:37,678 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 19:02:37,756 INFO [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310027f45f43b88be49b581fee2ba120cb235 to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310027f45f43b88be49b581fee2ba120cb235 2023-10-02 19:02:37,756 INFO [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310021c3833e27ec142cd86d8b23097f053e4 to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310021c3833e27ec142cd86d8b23097f053e4 2023-10-02 19:02:37,791 INFO [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportWithTargetName/5a48abaa29ede66a105a114b780213ab/.tmp/cf/e541e838d8e2438cb22bb0045a21e702 2023-10-02 19:02:37,791 INFO [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportWithTargetName/88fbff4be96039143c55e4c759df8f16/.tmp/cf/a8493d9f19a449bf8980607a16d0cc1f 2023-10-02 19:02:37,804 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportWithTargetName/5a48abaa29ede66a105a114b780213ab/.tmp/cf/e541e838d8e2438cb22bb0045a21e702 as hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportWithTargetName/5a48abaa29ede66a105a114b780213ab/cf/e541e838d8e2438cb22bb0045a21e702 2023-10-02 19:02:37,804 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportWithTargetName/88fbff4be96039143c55e4c759df8f16/.tmp/cf/a8493d9f19a449bf8980607a16d0cc1f as hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportWithTargetName/88fbff4be96039143c55e4c759df8f16/cf/a8493d9f19a449bf8980607a16d0cc1f 2023-10-02 19:02:37,815 INFO [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportWithTargetName/88fbff4be96039143c55e4c759df8f16/cf/a8493d9f19a449bf8980607a16d0cc1f, entries=47, sequenceid=6, filesize=12.8 K 2023-10-02 19:02:37,815 INFO [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportWithTargetName/5a48abaa29ede66a105a114b780213ab/cf/e541e838d8e2438cb22bb0045a21e702, entries=3, sequenceid=6, filesize=5.4 K 2023-10-02 19:02:37,819 INFO [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 5a48abaa29ede66a105a114b780213ab in 193ms, sequenceid=6, compaction requested=false 2023-10-02 19:02:37,819 INFO [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 88fbff4be96039143c55e4c759df8f16 in 193ms, sequenceid=6, compaction requested=false 2023-10-02 19:02:37,819 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-02 19:02:37,819 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-02 19:02:37,822 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 88fbff4be96039143c55e4c759df8f16: 2023-10-02 19:02:37,822 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5a48abaa29ede66a105a114b780213ab: 2023-10-02 19:02:37,823 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-02 19:02:37,823 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-02 19:02:37,823 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 19:02:37,823 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 19:02:37,823 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportWithTargetName/88fbff4be96039143c55e4c759df8f16/cf/a8493d9f19a449bf8980607a16d0cc1f] hfiles 2023-10-02 19:02:37,823 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportWithTargetName/5a48abaa29ede66a105a114b780213ab/cf/e541e838d8e2438cb22bb0045a21e702] hfiles 2023-10-02 19:02:37,823 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportWithTargetName/88fbff4be96039143c55e4c759df8f16/cf/a8493d9f19a449bf8980607a16d0cc1f for snapshot=snaptb0-testExportWithTargetName 2023-10-02 19:02:37,823 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportWithTargetName/5a48abaa29ede66a105a114b780213ab/cf/e541e838d8e2438cb22bb0045a21e702 for snapshot=snaptb0-testExportWithTargetName 2023-10-02 19:02:37,846 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab. completed. 2023-10-02 19:02:37,846 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab. 2023-10-02 19:02:37,846 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 19:02:37,846 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 19:02:37,846 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,846 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-02 19:02:37,846 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,34425,1696273349187' in zk 2023-10-02 19:02:37,848 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-02 19:02:37,848 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16. completed. 2023-10-02 19:02:37,848 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:02:37,848 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,848 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-02 19:02:37,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:02:37,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:02:37,848 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16. 2023-10-02 19:02:37,849 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 19:02:37,849 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 19:02:37,849 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,850 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-02 19:02:37,850 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,32897,1696273349258' in zk 2023-10-02 19:02:37,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:02:37,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:02:37,851 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,851 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-02 19:02:37,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 19:02:37,851 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:02:37,851 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-02 19:02:37,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:37,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:02:37,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 19:02:37,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:37,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,34425,1696273349187': 2023-10-02 19:02:37,856 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34425,1696273349187' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-02 19:02:37,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:02:37,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:02:37,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:02:37,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:02:37,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 19:02:37,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:37,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:02:37,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 19:02:37,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:37,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,32897,1696273349258': 2023-10-02 19:02:37,859 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,32897,1696273349258' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-02 19:02:37,859 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-10-02 19:02:37,859 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 19:02:37,859 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 19:02:37,859 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-10-02 19:02:37,859 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 19:02:37,868 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,868 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,868 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,868 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:02:37,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,868 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:02:37,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,868 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:02:37,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,868 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:02:37,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,868 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:02:37,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:02:37,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:02:37,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:02:37,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:02:37,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:02:37,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:02:37,869 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:37,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:02:37,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 19:02:37,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,869 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:02:37,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 19:02:37,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:37,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,871 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:02:37,871 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:37,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 19:02:37,872 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:37,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,879 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 19:02:37,884 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,884 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:02:37,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:02:37,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:02:37,884 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:02:37,884 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:02:37,884 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:02:37,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:02:37,884 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:02:37,884 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:02:37,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:02:37,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:02:37,884 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,885 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:37,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-02 19:02:37,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-02 19:02:37,885 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-10-02 19:02:37,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:02:37,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:02:37,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:02:37,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:02:37,885 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-02 19:02:37,885 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-02 19:02:37,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-02 19:02:37,885 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:02:37,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 19:02:37,885 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:02:37,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:02:37,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:02:37,887 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,887 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:37,887 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,887 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:37,887 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:37,887 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,887 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310027f45f43b88be49b581fee2ba120cb235, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310021c3833e27ec142cd86d8b23097f053e4] mob files 2023-10-02 19:02:37,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310027f45f43b88be49b581fee2ba120cb235 2023-10-02 19:02:37,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310021c3833e27ec142cd86d8b23097f053e4 2023-10-02 19:02:37,902 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-10-02 19:02:37,903 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,938 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,939 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-02 19:02:37,939 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,940 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-02 19:02:37,940 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696273357574Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696273357902 (+328 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1696273357902Loading Region manifests for snaptb0-testExportWithTargetName at 1696273357902Writing data manifest for snaptb0-testExportWithTargetName at 1696273357907 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1696273357926 (+19 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696273357939 (+13 ms) 2023-10-02 19:02:37,942 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-02 19:02:37,944 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 367 msec 2023-10-02 19:02:38,185 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 19:02:38,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-02 19:02:38,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 19:02:38,189 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273358189 2023-10-02 19:02:38,189 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46307, tgtDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273358189, rawTgtDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273358189, srcFsUri=hdfs://localhost:46307, srcDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6 2023-10-02 19:02:38,231 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46307, inputRoot=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6 2023-10-02 19:02:38,231 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2135802695_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273358189, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273358189/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-02 19:02:38,231 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46307, inputRoot=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6, snapshotDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-10-02 19:02:38,250 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273358189/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-02 19:02:38,307 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 19:02:38,309 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-10-02 19:02:38,310 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 19:02:38,310 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-10-02 19:02:38,310 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-02 19:02:38,310 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-10-02 19:02:38,310 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 19:02:38,310 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-10-02 19:02:38,310 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-02 19:02:38,310 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-10-02 19:02:38,721 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-02 19:02:38,722 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-02 19:02:38,722 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-02 19:02:38,722 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-02 19:02:39,475 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/hadoop-340032165914719668.jar 2023-10-02 19:02:39,476 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-02 19:02:39,476 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-02 19:02:39,533 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/hadoop-3925067848587546171.jar 2023-10-02 19:02:39,533 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-02 19:02:39,534 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-02 19:02:39,534 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-02 19:02:39,534 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-02 19:02:39,535 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-02 19:02:39,535 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-02 19:02:39,536 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-02 19:02:39,536 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-02 19:02:39,536 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-02 19:02:39,537 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-02 19:02:39,537 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-02 19:02:39,538 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-02 19:02:39,538 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-02 19:02:39,538 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-02 19:02:39,539 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-02 19:02:39,539 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-02 19:02:39,543 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 19:02:39,544 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 19:02:39,544 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 19:02:39,545 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 19:02:39,545 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 19:02:39,545 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 19:02:39,546 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 19:02:40,293 WARN [Listener at jenkins-hbase20.apache.org/42825] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-02 19:02:40,301 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-10-02 19:02:40,311 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-02 19:02:40,688 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 19:02:40,688 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 19:02:41,208 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696273355352_0001_000001 (auth:SIMPLE) 2023-10-02 19:02:42,374 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-02 19:02:45,194 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696273355352_0001_000001 (auth:SIMPLE) 2023-10-02 19:02:47,434 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696273355352_0001_000001 (auth:SIMPLE) 2023-10-02 19:02:50,727 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696273355352_0001_000001 (auth:SIMPLE) 2023-10-02 19:02:52,060 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-02 19:02:52,064 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-02 19:02:52,075 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-10-02 19:02:52,075 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-02 19:02:52,076 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-02 19:02:52,076 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1557508828_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-02 19:02:52,076 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(367): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-10-02 19:02:52,076 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(367): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-10-02 19:02:52,076 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1557508828_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273358189/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273358189/.hbase-snapshot/testExportWithTargetName 2023-10-02 19:02:52,077 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(367): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273358189/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-10-02 19:02:52,077 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(367): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273358189/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-10-02 19:02:52,089 INFO [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-10-02 19:02:52,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportWithTargetName 2023-10-02 19:02:52,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-10-02 19:02:52,107 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696273372107"}]},"ts":"1696273372107"} 2023-10-02 19:02:52,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-02 19:02:52,110 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-10-02 19:02:52,111 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-10-02 19:02:52,113 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5a48abaa29ede66a105a114b780213ab, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=88fbff4be96039143c55e4c759df8f16, UNASSIGN}] 2023-10-02 19:02:52,116 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5a48abaa29ede66a105a114b780213ab, UNASSIGN 2023-10-02 19:02:52,116 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=88fbff4be96039143c55e4c759df8f16, UNASSIGN 2023-10-02 19:02:52,117 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=88fbff4be96039143c55e4c759df8f16, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:52,117 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=5a48abaa29ede66a105a114b780213ab, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:52,117 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696273372117"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696273372117"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696273372117"}]},"ts":"1696273372117"} 2023-10-02 19:02:52,117 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696273372117"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696273372117"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696273372117"}]},"ts":"1696273372117"} 2023-10-02 19:02:52,120 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 88fbff4be96039143c55e4c759df8f16, server=jenkins-hbase20.apache.org,32897,1696273349258}] 2023-10-02 19:02:52,121 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 5a48abaa29ede66a105a114b780213ab, server=jenkins-hbase20.apache.org,34425,1696273349187}] 2023-10-02 19:02:52,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-02 19:02:52,281 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 88fbff4be96039143c55e4c759df8f16 2023-10-02 19:02:52,281 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 5a48abaa29ede66a105a114b780213ab 2023-10-02 19:02:52,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 88fbff4be96039143c55e4c759df8f16, disabling compactions & flushes 2023-10-02 19:02:52,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 5a48abaa29ede66a105a114b780213ab, disabling compactions & flushes 2023-10-02 19:02:52,281 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16. 2023-10-02 19:02:52,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16. 2023-10-02 19:02:52,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16. after waiting 0 ms 2023-10-02 19:02:52,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16. 2023-10-02 19:02:52,281 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab. 2023-10-02 19:02:52,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab. 2023-10-02 19:02:52,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab. after waiting 0 ms 2023-10-02 19:02:52,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab. 2023-10-02 19:02:52,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportWithTargetName/5a48abaa29ede66a105a114b780213ab/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 19:02:52,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportWithTargetName/88fbff4be96039143c55e4c759df8f16/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 19:02:52,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 19:02:52,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 19:02:52,301 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16. 2023-10-02 19:02:52,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 88fbff4be96039143c55e4c759df8f16: 2023-10-02 19:02:52,301 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab. 2023-10-02 19:02:52,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 5a48abaa29ede66a105a114b780213ab: 2023-10-02 19:02:52,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 5a48abaa29ede66a105a114b780213ab 2023-10-02 19:02:52,304 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=5a48abaa29ede66a105a114b780213ab, regionState=CLOSED 2023-10-02 19:02:52,304 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 88fbff4be96039143c55e4c759df8f16 2023-10-02 19:02:52,304 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696273372304"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696273372304"}]},"ts":"1696273372304"} 2023-10-02 19:02:52,305 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=88fbff4be96039143c55e4c759df8f16, regionState=CLOSED 2023-10-02 19:02:52,305 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696273372305"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696273372305"}]},"ts":"1696273372305"} 2023-10-02 19:02:52,310 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=22 2023-10-02 19:02:52,310 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 5a48abaa29ede66a105a114b780213ab, server=jenkins-hbase20.apache.org,34425,1696273349187 in 185 msec 2023-10-02 19:02:52,311 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-10-02 19:02:52,311 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 88fbff4be96039143c55e4c759df8f16, server=jenkins-hbase20.apache.org,32897,1696273349258 in 189 msec 2023-10-02 19:02:52,312 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5a48abaa29ede66a105a114b780213ab, UNASSIGN in 197 msec 2023-10-02 19:02:52,313 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=23, resume processing ppid=21 2023-10-02 19:02:52,313 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=88fbff4be96039143c55e4c759df8f16, UNASSIGN in 198 msec 2023-10-02 19:02:52,314 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696273372314"}]},"ts":"1696273372314"} 2023-10-02 19:02:52,319 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-10-02 19:02:52,320 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-10-02 19:02:52,324 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 225 msec 2023-10-02 19:02:52,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-02 19:02:52,411 INFO [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-10-02 19:02:52,416 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportWithTargetName 2023-10-02 19:02:52,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-02 19:02:52,426 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-02 19:02:52,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-10-02 19:02:52,429 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-02 19:02:52,432 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34425] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-10-02 19:02:52,434 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-02 19:02:52,435 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-02 19:02:52,435 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-02 19:02:52,435 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-02 19:02:52,436 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:02:52,436 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:02:52,436 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:02:52,436 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:02:52,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-02 19:02:52,440 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportWithTargetName/5a48abaa29ede66a105a114b780213ab 2023-10-02 19:02:52,441 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-02 19:02:52,441 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-02 19:02:52,441 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-02 19:02:52,441 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-02 19:02:52,441 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-02 19:02:52,441 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-02 19:02:52,442 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportWithTargetName/88fbff4be96039143c55e4c759df8f16 2023-10-02 19:02:52,443 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-02 19:02:52,443 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-02 19:02:52,445 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportWithTargetName/88fbff4be96039143c55e4c759df8f16/cf, FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportWithTargetName/88fbff4be96039143c55e4c759df8f16/recovered.edits] 2023-10-02 19:02:52,445 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportWithTargetName/5a48abaa29ede66a105a114b780213ab/cf, FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportWithTargetName/5a48abaa29ede66a105a114b780213ab/recovered.edits] 2023-10-02 19:02:52,452 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportWithTargetName/5a48abaa29ede66a105a114b780213ab/cf/e541e838d8e2438cb22bb0045a21e702 to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testExportWithTargetName/5a48abaa29ede66a105a114b780213ab/cf/e541e838d8e2438cb22bb0045a21e702 2023-10-02 19:02:52,452 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportWithTargetName/88fbff4be96039143c55e4c759df8f16/cf/a8493d9f19a449bf8980607a16d0cc1f to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testExportWithTargetName/88fbff4be96039143c55e4c759df8f16/cf/a8493d9f19a449bf8980607a16d0cc1f 2023-10-02 19:02:52,456 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportWithTargetName/88fbff4be96039143c55e4c759df8f16/recovered.edits/9.seqid to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testExportWithTargetName/88fbff4be96039143c55e4c759df8f16/recovered.edits/9.seqid 2023-10-02 19:02:52,456 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportWithTargetName/5a48abaa29ede66a105a114b780213ab/recovered.edits/9.seqid to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testExportWithTargetName/5a48abaa29ede66a105a114b780213ab/recovered.edits/9.seqid 2023-10-02 19:02:52,457 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportWithTargetName/88fbff4be96039143c55e4c759df8f16 2023-10-02 19:02:52,457 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportWithTargetName/5a48abaa29ede66a105a114b780213ab 2023-10-02 19:02:52,457 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-02 19:02:52,457 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-02 19:02:52,458 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-10-02 19:02:52,462 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310027f45f43b88be49b581fee2ba120cb235 to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310027f45f43b88be49b581fee2ba120cb235 2023-10-02 19:02:52,464 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310021c3833e27ec142cd86d8b23097f053e4 to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310021c3833e27ec142cd86d8b23097f053e4 2023-10-02 19:02:52,465 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-02 19:02:52,468 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-02 19:02:52,487 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-10-02 19:02:52,490 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-10-02 19:02:52,492 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-02 19:02:52,492 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-10-02 19:02:52,492 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696273372492"}]},"ts":"9223372036854775807"} 2023-10-02 19:02:52,492 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696273372492"}]},"ts":"9223372036854775807"} 2023-10-02 19:02:52,495 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-02 19:02:52,495 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5a48abaa29ede66a105a114b780213ab, NAME => 'testtb-testExportWithTargetName,,1696273356400.5a48abaa29ede66a105a114b780213ab.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 88fbff4be96039143c55e4c759df8f16, NAME => 'testtb-testExportWithTargetName,1,1696273356400.88fbff4be96039143c55e4c759df8f16.', STARTKEY => '1', ENDKEY => ''}] 2023-10-02 19:02:52,495 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-10-02 19:02:52,495 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696273372495"}]},"ts":"9223372036854775807"} 2023-10-02 19:02:52,497 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-10-02 19:02:52,499 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-02 19:02:52,501 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 82 msec 2023-10-02 19:02:52,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-02 19:02:52,544 INFO [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-10-02 19:02:52,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportWithTargetName" 2023-10-02 19:02:52,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-10-02 19:02:52,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportWithTargetName" 2023-10-02 19:02:52,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportWithTargetName 2023-10-02 19:02:52,607 INFO [Listener at jenkins-hbase20.apache.org/42825] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=761 (was 709) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_437220990_1 at /127.0.0.1:60396 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/cluster_34384d40-947b-ffab-8334-c2f5aa364294/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1557508828_17 at /127.0.0.1:57718 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/cluster_34384d40-947b-ffab-8334-c2f5aa364294/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/cluster_34384d40-947b-ffab-8334-c2f5aa364294/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1470868269) connection to jenkins-hbase20.apache.org/148.251.75.209:37201 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1284 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb2bac33-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/cluster_34384d40-947b-ffab-8334-c2f5aa364294/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1557508828_17 at /127.0.0.1:60418 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1470868269) connection to jenkins-hbase20.apache.org/148.251.75.209:34683 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1470868269) connection to jenkins-hbase20.apache.org/148.251.75.209:42825 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb2bac33-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_437220990_1 at /127.0.0.1:39242 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1470868269) connection to jenkins-hbase20.apache.org/148.251.75.209:42069 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/cluster_34384d40-947b-ffab-8334-c2f5aa364294/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb2bac33-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb2bac33-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/cluster_34384d40-947b-ffab-8334-c2f5aa364294/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1557508828_17 at /127.0.0.1:39260 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=942 (was 901) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=215 (was 170) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=4942 (was 5729) 2023-10-02 19:02:52,607 WARN [Listener at jenkins-hbase20.apache.org/42825] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-10-02 19:02:52,627 INFO [Listener at jenkins-hbase20.apache.org/42825] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=761, OpenFileDescriptor=942, MaxFileDescriptor=60000, SystemLoadAverage=215, ProcessCount=171, AvailableMemoryMB=4940 2023-10-02 19:02:52,628 WARN [Listener at jenkins-hbase20.apache.org/42825] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-10-02 19:02:52,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-02 19:02:52,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-10-02 19:02:52,637 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 19:02:52,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-10-02 19:02:52,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-02 19:02:52,640 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 19:02:52,643 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemState/3915fc90bdf5308f075230d7743aea58 2023-10-02 19:02:52,643 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemState/48efd353bc9f50e1acc79ead47002070 2023-10-02 19:02:52,644 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemState/3915fc90bdf5308f075230d7743aea58 empty. 2023-10-02 19:02:52,644 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemState/48efd353bc9f50e1acc79ead47002070 empty. 2023-10-02 19:02:52,644 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemState/3915fc90bdf5308f075230d7743aea58 2023-10-02 19:02:52,644 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemState/48efd353bc9f50e1acc79ead47002070 2023-10-02 19:02:52,644 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-02 19:02:52,656 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-02 19:02:52,658 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3915fc90bdf5308f075230d7743aea58, NAME => 'testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp 2023-10-02 19:02:52,658 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 48efd353bc9f50e1acc79ead47002070, NAME => 'testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp 2023-10-02 19:02:52,682 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:02:52,684 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:02:52,685 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 3915fc90bdf5308f075230d7743aea58, disabling compactions & flushes 2023-10-02 19:02:52,685 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 48efd353bc9f50e1acc79ead47002070, disabling compactions & flushes 2023-10-02 19:02:52,685 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58. 2023-10-02 19:02:52,685 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58. 2023-10-02 19:02:52,685 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070. 2023-10-02 19:02:52,685 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58. after waiting 0 ms 2023-10-02 19:02:52,685 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58. 2023-10-02 19:02:52,685 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070. 2023-10-02 19:02:52,685 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58. 2023-10-02 19:02:52,685 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070. after waiting 0 ms 2023-10-02 19:02:52,685 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 3915fc90bdf5308f075230d7743aea58: 2023-10-02 19:02:52,685 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070. 2023-10-02 19:02:52,685 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070. 2023-10-02 19:02:52,685 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 48efd353bc9f50e1acc79ead47002070: 2023-10-02 19:02:52,688 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 19:02:52,690 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696273372689"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696273372689"}]},"ts":"1696273372689"} 2023-10-02 19:02:52,690 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696273372689"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696273372689"}]},"ts":"1696273372689"} 2023-10-02 19:02:52,693 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-02 19:02:52,694 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 19:02:52,694 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696273372694"}]},"ts":"1696273372694"} 2023-10-02 19:02:52,696 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-10-02 19:02:52,698 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-10-02 19:02:52,699 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 19:02:52,699 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 19:02:52,699 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 19:02:52,699 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 19:02:52,700 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3915fc90bdf5308f075230d7743aea58, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=48efd353bc9f50e1acc79ead47002070, ASSIGN}] 2023-10-02 19:02:52,702 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3915fc90bdf5308f075230d7743aea58, ASSIGN 2023-10-02 19:02:52,702 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=48efd353bc9f50e1acc79ead47002070, ASSIGN 2023-10-02 19:02:52,704 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=48efd353bc9f50e1acc79ead47002070, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34425,1696273349187; forceNewPlan=false, retain=false 2023-10-02 19:02:52,704 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3915fc90bdf5308f075230d7743aea58, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,32897,1696273349258; forceNewPlan=false, retain=false 2023-10-02 19:02:52,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-02 19:02:52,854 INFO [jenkins-hbase20:32777] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-02 19:02:52,856 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=3915fc90bdf5308f075230d7743aea58, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:52,856 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=48efd353bc9f50e1acc79ead47002070, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:52,857 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696273372856"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696273372856"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696273372856"}]},"ts":"1696273372856"} 2023-10-02 19:02:52,857 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696273372856"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696273372856"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696273372856"}]},"ts":"1696273372856"} 2023-10-02 19:02:52,859 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 3915fc90bdf5308f075230d7743aea58, server=jenkins-hbase20.apache.org,32897,1696273349258}] 2023-10-02 19:02:52,860 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 48efd353bc9f50e1acc79ead47002070, server=jenkins-hbase20.apache.org,34425,1696273349187}] 2023-10-02 19:02:52,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-02 19:02:53,015 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58. 2023-10-02 19:02:53,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3915fc90bdf5308f075230d7743aea58, NAME => 'testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58.', STARTKEY => '', ENDKEY => '1'} 2023-10-02 19:02:53,015 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070. 2023-10-02 19:02:53,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 48efd353bc9f50e1acc79ead47002070, NAME => 'testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070.', STARTKEY => '1', ENDKEY => ''} 2023-10-02 19:02:53,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58. service=AccessControlService 2023-10-02 19:02:53,016 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 19:02:53,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 3915fc90bdf5308f075230d7743aea58 2023-10-02 19:02:53,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:02:53,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070. service=AccessControlService 2023-10-02 19:02:53,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 3915fc90bdf5308f075230d7743aea58 2023-10-02 19:02:53,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 3915fc90bdf5308f075230d7743aea58 2023-10-02 19:02:53,016 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 19:02:53,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 48efd353bc9f50e1acc79ead47002070 2023-10-02 19:02:53,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:02:53,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 48efd353bc9f50e1acc79ead47002070 2023-10-02 19:02:53,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 48efd353bc9f50e1acc79ead47002070 2023-10-02 19:02:53,018 INFO [StoreOpener-3915fc90bdf5308f075230d7743aea58-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3915fc90bdf5308f075230d7743aea58 2023-10-02 19:02:53,022 INFO [StoreOpener-48efd353bc9f50e1acc79ead47002070-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 48efd353bc9f50e1acc79ead47002070 2023-10-02 19:02:53,024 DEBUG [StoreOpener-3915fc90bdf5308f075230d7743aea58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemState/3915fc90bdf5308f075230d7743aea58/cf 2023-10-02 19:02:53,024 DEBUG [StoreOpener-3915fc90bdf5308f075230d7743aea58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemState/3915fc90bdf5308f075230d7743aea58/cf 2023-10-02 19:02:53,024 DEBUG [StoreOpener-48efd353bc9f50e1acc79ead47002070-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemState/48efd353bc9f50e1acc79ead47002070/cf 2023-10-02 19:02:53,024 DEBUG [StoreOpener-48efd353bc9f50e1acc79ead47002070-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemState/48efd353bc9f50e1acc79ead47002070/cf 2023-10-02 19:02:53,024 INFO [StoreOpener-3915fc90bdf5308f075230d7743aea58-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3915fc90bdf5308f075230d7743aea58 columnFamilyName cf 2023-10-02 19:02:53,025 INFO [StoreOpener-48efd353bc9f50e1acc79ead47002070-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 48efd353bc9f50e1acc79ead47002070 columnFamilyName cf 2023-10-02 19:02:53,026 INFO [StoreOpener-3915fc90bdf5308f075230d7743aea58-1] regionserver.HStore(310): Store=3915fc90bdf5308f075230d7743aea58/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 19:02:53,027 INFO [StoreOpener-48efd353bc9f50e1acc79ead47002070-1] regionserver.HStore(310): Store=48efd353bc9f50e1acc79ead47002070/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 19:02:53,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemState/48efd353bc9f50e1acc79ead47002070 2023-10-02 19:02:53,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemState/3915fc90bdf5308f075230d7743aea58 2023-10-02 19:02:53,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemState/48efd353bc9f50e1acc79ead47002070 2023-10-02 19:02:53,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemState/3915fc90bdf5308f075230d7743aea58 2023-10-02 19:02:53,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 3915fc90bdf5308f075230d7743aea58 2023-10-02 19:02:53,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 48efd353bc9f50e1acc79ead47002070 2023-10-02 19:02:53,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemState/3915fc90bdf5308f075230d7743aea58/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 19:02:53,037 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 3915fc90bdf5308f075230d7743aea58; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68874623, jitterRate=0.026311859488487244}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 19:02:53,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 3915fc90bdf5308f075230d7743aea58: 2023-10-02 19:02:53,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemState/48efd353bc9f50e1acc79ead47002070/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 19:02:53,038 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58., pid=30, masterSystemTime=1696273373011 2023-10-02 19:02:53,038 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 48efd353bc9f50e1acc79ead47002070; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71573273, jitterRate=0.06652487814426422}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 19:02:53,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 48efd353bc9f50e1acc79ead47002070: 2023-10-02 19:02:53,039 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070., pid=31, masterSystemTime=1696273373012 2023-10-02 19:02:53,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58. 2023-10-02 19:02:53,041 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58. 2023-10-02 19:02:53,042 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=3915fc90bdf5308f075230d7743aea58, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,042 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696273373042"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696273373042"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696273373042"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696273373042"}]},"ts":"1696273373042"} 2023-10-02 19:02:53,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070. 2023-10-02 19:02:53,043 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070. 2023-10-02 19:02:53,043 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=48efd353bc9f50e1acc79ead47002070, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,045 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696273373043"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696273373043"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696273373043"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696273373043"}]},"ts":"1696273373043"} 2023-10-02 19:02:53,052 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=28 2023-10-02 19:02:53,052 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-10-02 19:02:53,053 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 3915fc90bdf5308f075230d7743aea58, server=jenkins-hbase20.apache.org,32897,1696273349258 in 189 msec 2023-10-02 19:02:53,053 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 48efd353bc9f50e1acc79ead47002070, server=jenkins-hbase20.apache.org,34425,1696273349187 in 188 msec 2023-10-02 19:02:53,056 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=48efd353bc9f50e1acc79ead47002070, ASSIGN in 352 msec 2023-10-02 19:02:53,058 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-10-02 19:02:53,058 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3915fc90bdf5308f075230d7743aea58, ASSIGN in 353 msec 2023-10-02 19:02:53,059 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 19:02:53,059 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696273373059"}]},"ts":"1696273373059"} 2023-10-02 19:02:53,062 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-10-02 19:02:53,065 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 19:02:53,066 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-10-02 19:02:53,068 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34425] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-02 19:02:53,075 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:02:53,075 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:02:53,080 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:02:53,081 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:02:53,084 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 19:02:53,084 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 19:02:53,084 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 19:02:53,085 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-02 19:02:53,085 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-02 19:02:53,085 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-02 19:02:53,088 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-02 19:02:53,092 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 456 msec 2023-10-02 19:02:53,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-02 19:02:53,245 INFO [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-10-02 19:02:53,248 DEBUG [Listener at jenkins-hbase20.apache.org/42825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-02 19:02:53,248 DEBUG [Listener at jenkins-hbase20.apache.org/42825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58. 2023-10-02 19:02:53,251 INFO [Listener at jenkins-hbase20.apache.org/42825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 19:02:53,273 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 19:02:53,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696273373273 (current time:1696273373273). 2023-10-02 19:02:53,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 19:02:53,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(139): Connect 0x5b940a1b to 127.0.0.1:60248 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 19:02:53,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@554b9b49, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 19:02:53,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:02:53,295 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53402, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:02:53,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b940a1b to 127.0.0.1:60248 2023-10-02 19:02:53,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:02:53,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(139): Connect 0x54e5798b to 127.0.0.1:60248 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 19:02:53,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f5a65de, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 19:02:53,309 DEBUG [hconnection-0x264222af-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:02:53,313 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53410, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:02:53,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:02:53,321 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47756, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:02:53,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54e5798b to 127.0.0.1:60248 2023-10-02 19:02:53,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:02:53,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-02 19:02:53,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 19:02:53,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 19:02:53,328 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot, current working dir path: hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 19:02:53,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-02 19:02:53,333 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-02 19:02:53,334 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696273973334 2023-10-02 19:02:53,334 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-02 19:02:53,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 19:02:53,336 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 19:02:53,337 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 19:02:53,337 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-02 19:02:53,339 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-02 19:02:53,342 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-10-02 19:02:53,344 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-02 19:02:53,345 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696273973345 2023-10-02 19:02:53,359 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,359 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-10-02 19:02:53,359 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:02:53,360 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-10-02 19:02:53,360 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-02 19:02:53,437 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 19:02:53,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 19:02:53,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-02 19:02:53,438 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 19:02:53,442 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,442 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,443 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:02:53,443 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:02:53,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:02:53,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:02:53,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:02:53,443 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:02:53,443 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:02:53,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:02:53,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:02:53,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,444 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,444 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,444 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,444 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,444 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-02 19:02:53,444 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,444 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 19:02:53,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-02 19:02:53,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-02 19:02:53,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,445 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-02 19:02:53,445 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-02 19:02:53,445 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-02 19:02:53,445 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,445 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,445 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-02 19:02:53,445 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-02 19:02:53,445 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:02:53,445 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,445 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:02:53,447 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-02 19:02:53,447 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-02 19:02:53,448 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:02:53,448 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-02 19:02:53,449 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-02 19:02:53,449 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38887,1696273349229' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-02 19:02:53,449 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-02 19:02:53,449 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-02 19:02:53,448 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-02 19:02:53,449 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34425,1696273349187' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-02 19:02:53,449 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,32897,1696273349258' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-02 19:02:53,456 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,460 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,460 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,460 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:02:53,460 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,460 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,460 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:02:53,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:02:53,460 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,461 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:02:53,461 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,461 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:02:53,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:02:53,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:02:53,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:53,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:02:53,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,32897,1696273349258' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-02 19:02:53,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17e4859a[Count = 1] remaining members to acquire global barrier 2023-10-02 19:02:53,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:02:53,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:02:53,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:02:53,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:02:53,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:53,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:02:53,464 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34425,1696273349187' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-02 19:02:53,464 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17e4859a[Count = 0] remaining members to acquire global barrier 2023-10-02 19:02:53,464 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-02 19:02:53,465 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,467 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,467 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,467 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,467 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-02 19:02:53,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,467 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,467 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 19:02:53,467 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 19:02:53,467 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070. 2023-10-02 19:02:53,467 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-02 19:02:53,468 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,468 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 19:02:53,467 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-02 19:02:53,468 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-02 19:02:53,468 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070. started... 2023-10-02 19:02:53,468 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,38887,1696273349229' in zk 2023-10-02 19:02:53,468 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 19:02:53,468 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 19:02:53,468 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58. 2023-10-02 19:02:53,469 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 48efd353bc9f50e1acc79ead47002070: 2023-10-02 19:02:53,469 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58. started... 2023-10-02 19:02:53,470 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3915fc90bdf5308f075230d7743aea58: 2023-10-02 19:02:53,470 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,470 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,470 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 19:02:53,470 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 19:02:53,470 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 19:02:53,470 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 19:02:53,470 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-02 19:02:53,470 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:02:53,470 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-02 19:02:53,487 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58. completed. 2023-10-02 19:02:53,487 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58. 2023-10-02 19:02:53,487 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 19:02:53,487 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 19:02:53,487 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,487 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-02 19:02:53,487 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,32897,1696273349258' in zk 2023-10-02 19:02:53,490 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070. completed. 2023-10-02 19:02:53,491 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070. 2023-10-02 19:02:53,491 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 19:02:53,491 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 19:02:53,491 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,491 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-02 19:02:53,491 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,34425,1696273349187' in zk 2023-10-02 19:02:53,498 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-02 19:02:53,498 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,498 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:02:53,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:02:53,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:02:53,498 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-02 19:02:53,501 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,501 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-02 19:02:53,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:02:53,501 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:02:53,501 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-02 19:02:53,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:02:53,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:53,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:02:53,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:53,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,32897,1696273349258': 2023-10-02 19:02:53,506 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,32897,1696273349258' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-02 19:02:53,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:02:53,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:02:53,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:02:53,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:02:53,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:53,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:02:53,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:53,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,34425,1696273349187': 2023-10-02 19:02:53,509 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34425,1696273349187' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-02 19:02:53,509 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-10-02 19:02:53,509 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 19:02:53,509 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 19:02:53,510 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,510 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 19:02:53,517 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,517 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,517 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:02:53,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,517 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:02:53,517 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,517 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:02:53,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:02:53,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,517 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:02:53,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:02:53,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:02:53,518 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:02:53,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:02:53,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:02:53,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:02:53,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:02:53,518 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:53,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,519 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:02:53,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:53,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,520 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:02:53,521 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:53,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,521 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:53,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,525 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:02:53,525 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:02:53,525 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:02:53,525 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:02:53,526 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:02:53,526 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:02:53,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:02:53,526 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:02:53,526 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:02:53,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:02:53,526 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,525 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:02:53,528 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:53,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:02:53,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:02:53,526 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-02 19:02:53,528 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:02:53,528 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:02:53,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:02:53,528 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 19:02:53,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:02:53,528 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:02:53,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:02:53,529 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,529 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,529 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:53,529 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,529 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,529 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,529 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-02 19:02:53,540 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,541 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,576 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,577 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-02 19:02:53,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,578 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-02 19:02:53,578 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696273373335Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696273373540 (+205 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1696273373540Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1696273373540Writing data manifest for emptySnaptb0-testExportFileSystemState at 1696273373545 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1696273373566 (+21 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696273373577 (+11 ms) 2023-10-02 19:02:53,582 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-02 19:02:53,585 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 246 msec 2023-10-02 19:02:53,638 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 19:02:53,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 19:02:53,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 19:02:53,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32897] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 19:02:53,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34425] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 19:02:53,651 DEBUG [Listener at jenkins-hbase20.apache.org/42825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-02 19:02:53,651 DEBUG [Listener at jenkins-hbase20.apache.org/42825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58. 2023-10-02 19:02:53,652 INFO [Listener at jenkins-hbase20.apache.org/42825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 19:02:53,666 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 19:02:53,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696273373666 (current time:1696273373666). 2023-10-02 19:02:53,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 19:02:53,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(139): Connect 0x43fe8549 to 127.0.0.1:60248 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 19:02:53,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3cf0585b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 19:02:53,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:02:53,681 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53426, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:02:53,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43fe8549 to 127.0.0.1:60248 2023-10-02 19:02:53,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:02:53,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(139): Connect 0x526b9af3 to 127.0.0.1:60248 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 19:02:53,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b843750, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 19:02:53,695 DEBUG [hconnection-0x5e4bc947-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:02:53,696 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53438, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:02:53,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:02:53,705 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47768, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:02:53,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x526b9af3 to 127.0.0.1:60248 2023-10-02 19:02:53,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:02:53,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-02 19:02:53,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 19:02:53,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 19:02:53,711 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot, current working dir path: hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 19:02:53,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-02 19:02:53,715 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-02 19:02:53,716 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696273973716 2023-10-02 19:02:53,716 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-02 19:02:53,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 19:02:53,718 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 19:02:53,718 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 19:02:53,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-02 19:02:53,720 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-02 19:02:53,722 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-10-02 19:02:53,723 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-02 19:02:53,724 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696273973724 2023-10-02 19:02:53,734 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-10-02 19:02:53,734 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-10-02 19:02:53,734 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:02:53,736 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-10-02 19:02:53,736 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-02 19:02:53,736 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,736 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,737 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:02:53,737 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:02:53,737 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:02:53,737 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:02:53,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:02:53,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:02:53,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:02:53,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:02:53,737 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:02:53,738 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,738 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,738 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,738 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 19:02:53,738 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,738 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-02 19:02:53,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-02 19:02:53,738 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-02 19:02:53,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-02 19:02:53,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,739 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-02 19:02:53,739 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-02 19:02:53,739 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-02 19:02:53,739 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-02 19:02:53,739 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-02 19:02:53,739 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-02 19:02:53,739 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-02 19:02:53,739 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-02 19:02:53,739 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:02:53,739 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:02:53,739 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:02:53,741 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-02 19:02:53,742 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-02 19:02:53,740 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-02 19:02:53,742 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38887,1696273349229' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-02 19:02:53,742 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-02 19:02:53,742 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-02 19:02:53,742 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-02 19:02:53,742 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34425,1696273349187' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-02 19:02:53,742 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,32897,1696273349258' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-02 19:02:53,750 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,751 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,751 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,751 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:02:53,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:02:53,751 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,751 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,751 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:02:53,751 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,751 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,751 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:02:53,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:02:53,751 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:02:53,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:02:53,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 19:02:53,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:53,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:02:53,753 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,32897,1696273349258' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-02 19:02:53,753 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9a46a64[Count = 1] remaining members to acquire global barrier 2023-10-02 19:02:53,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:02:53,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:02:53,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:02:53,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:02:53,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 19:02:53,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:53,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:02:53,755 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34425,1696273349187' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-02 19:02:53,755 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9a46a64[Count = 0] remaining members to acquire global barrier 2023-10-02 19:02:53,755 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-02 19:02:53,755 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,756 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,756 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,756 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,756 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,756 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-02 19:02:53,756 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-02 19:02:53,756 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-02 19:02:53,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,757 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 19:02:53,757 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 19:02:53,756 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,38887,1696273349229' in zk 2023-10-02 19:02:53,756 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,757 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 19:02:53,757 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58. 2023-10-02 19:02:53,757 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-02 19:02:53,757 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58. started... 2023-10-02 19:02:53,757 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 19:02:53,757 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 19:02:53,757 INFO [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3915fc90bdf5308f075230d7743aea58 1/1 column families, dataSize=65 B heapSize=400 B 2023-10-02 19:02:53,757 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070. 2023-10-02 19:02:53,757 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070. started... 2023-10-02 19:02:53,757 INFO [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 48efd353bc9f50e1acc79ead47002070 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-10-02 19:02:53,758 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-02 19:02:53,758 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:02:53,758 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-02 19:02:53,783 INFO [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231002a0cd2326234c4cecab23755a6d7c2cc5 to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231002a0cd2326234c4cecab23755a6d7c2cc5 2023-10-02 19:02:53,793 INFO [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310029383392f224540398cfa0ec234a58a0e to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310029383392f224540398cfa0ec234a58a0e 2023-10-02 19:02:53,797 INFO [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemState/3915fc90bdf5308f075230d7743aea58/.tmp/cf/0710eaa484d8485ea84244e284d92b46 2023-10-02 19:02:53,806 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemState/3915fc90bdf5308f075230d7743aea58/.tmp/cf/0710eaa484d8485ea84244e284d92b46 as hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemState/3915fc90bdf5308f075230d7743aea58/cf/0710eaa484d8485ea84244e284d92b46 2023-10-02 19:02:53,813 INFO [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemState/3915fc90bdf5308f075230d7743aea58/cf/0710eaa484d8485ea84244e284d92b46, entries=1, sequenceid=6, filesize=5.1 K 2023-10-02 19:02:53,814 INFO [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for 3915fc90bdf5308f075230d7743aea58 in 57ms, sequenceid=6, compaction requested=false 2023-10-02 19:02:53,814 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-10-02 19:02:53,815 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3915fc90bdf5308f075230d7743aea58: 2023-10-02 19:02:53,815 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-02 19:02:53,815 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 19:02:53,815 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemState/3915fc90bdf5308f075230d7743aea58/cf/0710eaa484d8485ea84244e284d92b46] hfiles 2023-10-02 19:02:53,815 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemState/3915fc90bdf5308f075230d7743aea58/cf/0710eaa484d8485ea84244e284d92b46 for snapshot=snaptb0-testExportFileSystemState 2023-10-02 19:02:53,816 INFO [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemState/48efd353bc9f50e1acc79ead47002070/.tmp/cf/1b4e7c360d2348d58eb20f7339a573ab 2023-10-02 19:02:53,819 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 19:02:53,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 19:02:53,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-02 19:02:53,821 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 19:02:53,827 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemState/48efd353bc9f50e1acc79ead47002070/.tmp/cf/1b4e7c360d2348d58eb20f7339a573ab as hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemState/48efd353bc9f50e1acc79ead47002070/cf/1b4e7c360d2348d58eb20f7339a573ab 2023-10-02 19:02:53,828 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58. completed. 2023-10-02 19:02:53,828 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58. 2023-10-02 19:02:53,828 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 19:02:53,828 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 19:02:53,828 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,828 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-02 19:02:53,828 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,32897,1696273349258' in zk 2023-10-02 19:02:53,830 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-02 19:02:53,830 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,830 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:02:53,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:02:53,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:02:53,830 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-02 19:02:53,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:02:53,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:02:53,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 19:02:53,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:53,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:02:53,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 19:02:53,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:53,836 INFO [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemState/48efd353bc9f50e1acc79ead47002070/cf/1b4e7c360d2348d58eb20f7339a573ab, entries=49, sequenceid=6, filesize=13.2 K 2023-10-02 19:02:53,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,32897,1696273349258': 2023-10-02 19:02:53,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,32897,1696273349258' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-02 19:02:53,837 INFO [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for 48efd353bc9f50e1acc79ead47002070 in 80ms, sequenceid=6, compaction requested=false 2023-10-02 19:02:53,838 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 48efd353bc9f50e1acc79ead47002070: 2023-10-02 19:02:53,838 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-02 19:02:53,838 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 19:02:53,838 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemState/48efd353bc9f50e1acc79ead47002070/cf/1b4e7c360d2348d58eb20f7339a573ab] hfiles 2023-10-02 19:02:53,838 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemState/48efd353bc9f50e1acc79ead47002070/cf/1b4e7c360d2348d58eb20f7339a573ab for snapshot=snaptb0-testExportFileSystemState 2023-10-02 19:02:53,854 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070. completed. 2023-10-02 19:02:53,854 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070. 2023-10-02 19:02:53,855 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 19:02:53,855 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 19:02:53,855 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,855 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-02 19:02:53,855 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,34425,1696273349187' in zk 2023-10-02 19:02:53,856 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-02 19:02:53,856 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:02:53,856 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,856 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-02 19:02:53,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:02:53,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:02:53,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:02:53,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:02:53,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 19:02:53,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:53,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:02:53,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 19:02:53,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:53,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,34425,1696273349187': 2023-10-02 19:02:53,861 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34425,1696273349187' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-02 19:02:53,861 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-10-02 19:02:53,861 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 19:02:53,861 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 19:02:53,861 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-10-02 19:02:53,861 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 19:02:53,873 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,873 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,873 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,874 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:02:53,873 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:02:53,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:02:53,873 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:02:53,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,874 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:02:53,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:02:53,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,874 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:02:53,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:02:53,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:02:53,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:02:53,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:02:53,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:02:53,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,875 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:53,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 19:02:53,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,875 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:02:53,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 19:02:53,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:53,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:02:53,876 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 19:02:53,877 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:53,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,877 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:53,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,882 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,882 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,882 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:02:53,882 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:02:53,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:02:53,882 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:02:53,882 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:02:53,882 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:02:53,882 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:53,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:02:53,883 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,883 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:02:53,882 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-10-02 19:02:53,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:02:53,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:02:53,882 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:02:53,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:02:53,883 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-02 19:02:53,883 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:02:53,884 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:02:53,884 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-02 19:02:53,884 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 19:02:53,884 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:02:53,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:02:53,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:02:53,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:02:53,884 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:02:53,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:02:53,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:02:53,884 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:02:53,884 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,884 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310029383392f224540398cfa0ec234a58a0e, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231002a0cd2326234c4cecab23755a6d7c2cc5] mob files 2023-10-02 19:02:53,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310029383392f224540398cfa0ec234a58a0e 2023-10-02 19:02:53,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231002a0cd2326234c4cecab23755a6d7c2cc5 2023-10-02 19:02:53,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-10-02 19:02:53,898 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,925 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-02 19:02:53,925 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,925 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-02 19:02:53,925 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696273373716Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696273373897 (+181 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1696273373897Loading Region manifests for snaptb0-testExportFileSystemState at 1696273373897Writing data manifest for snaptb0-testExportFileSystemState at 1696273373901 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1696273373911 (+10 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696273373925 (+14 ms) 2023-10-02 19:02:53,928 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-02 19:02:53,930 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 211 msec 2023-10-02 19:02:54,021 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 19:02:54,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 19:02:54,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 19:02:54,023 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273374023 2023-10-02 19:02:54,023 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46307, tgtDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273374023, rawTgtDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273374023, srcFsUri=hdfs://localhost:46307, srcDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6 2023-10-02 19:02:54,045 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46307, inputRoot=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6 2023-10-02 19:02:54,045 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1041548298_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273374023, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273374023/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-02 19:02:54,045 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46307, inputRoot=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6, snapshotDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-10-02 19:02:54,055 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273374023/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-02 19:02:54,083 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-02 19:02:54,083 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-02 19:02:54,084 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-02 19:02:54,084 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-02 19:02:54,823 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/hadoop-909442300871929312.jar 2023-10-02 19:02:54,824 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-02 19:02:54,824 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-02 19:02:54,881 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/hadoop-8988236775273308616.jar 2023-10-02 19:02:54,882 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-02 19:02:54,882 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-02 19:02:54,882 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-02 19:02:54,883 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-02 19:02:54,883 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-02 19:02:54,884 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-02 19:02:54,884 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-02 19:02:54,884 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-02 19:02:54,885 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-02 19:02:54,885 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-02 19:02:54,885 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-02 19:02:54,886 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-02 19:02:54,886 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-02 19:02:54,886 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-02 19:02:54,887 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-02 19:02:54,887 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-02 19:02:54,888 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 19:02:54,888 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 19:02:54,889 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 19:02:54,889 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 19:02:54,889 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 19:02:54,890 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 19:02:54,890 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 19:02:55,851 WARN [Listener at jenkins-hbase20.apache.org/42825] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-02 19:02:55,853 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-10-02 19:02:55,856 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-02 19:02:56,925 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 19:02:56,926 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 19:02:56,931 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696273355352_0001_000001 (auth:SIMPLE) 2023-10-02 19:02:57,337 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696273355352_0002_000001 (auth:SIMPLE) 2023-10-02 19:02:57,903 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-02 19:03:00,936 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696273355352_0002_000001 (auth:SIMPLE) 2023-10-02 19:03:03,143 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696273355352_0002_000001 (auth:SIMPLE) 2023-10-02 19:03:05,334 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696273355352_0002_000001 (auth:SIMPLE) 2023-10-02 19:03:07,146 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-02 19:03:07,147 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-02 19:03:07,153 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-10-02 19:03:07,153 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-02 19:03:07,154 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-02 19:03:07,154 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1557508828_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-02 19:03:07,154 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(367): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-02 19:03:07,154 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(367): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-02 19:03:07,154 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1557508828_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273374023/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273374023/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-02 19:03:07,155 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(367): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273374023/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-02 19:03:07,155 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(367): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273374023/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-02 19:03:07,163 INFO [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-10-02 19:03:07,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemState 2023-10-02 19:03:07,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-10-02 19:03:07,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-02 19:03:07,169 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696273387169"}]},"ts":"1696273387169"} 2023-10-02 19:03:07,171 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-10-02 19:03:07,172 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-10-02 19:03:07,173 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3915fc90bdf5308f075230d7743aea58, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=48efd353bc9f50e1acc79ead47002070, UNASSIGN}] 2023-10-02 19:03:07,175 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=48efd353bc9f50e1acc79ead47002070, UNASSIGN 2023-10-02 19:03:07,175 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3915fc90bdf5308f075230d7743aea58, UNASSIGN 2023-10-02 19:03:07,176 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=48efd353bc9f50e1acc79ead47002070, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:07,176 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=3915fc90bdf5308f075230d7743aea58, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:07,176 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696273387176"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696273387176"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696273387176"}]},"ts":"1696273387176"} 2023-10-02 19:03:07,176 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696273387176"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696273387176"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696273387176"}]},"ts":"1696273387176"} 2023-10-02 19:03:07,178 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 48efd353bc9f50e1acc79ead47002070, server=jenkins-hbase20.apache.org,34425,1696273349187}] 2023-10-02 19:03:07,179 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 3915fc90bdf5308f075230d7743aea58, server=jenkins-hbase20.apache.org,32897,1696273349258}] 2023-10-02 19:03:07,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-02 19:03:07,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 48efd353bc9f50e1acc79ead47002070 2023-10-02 19:03:07,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 3915fc90bdf5308f075230d7743aea58 2023-10-02 19:03:07,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 48efd353bc9f50e1acc79ead47002070, disabling compactions & flushes 2023-10-02 19:03:07,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070. 2023-10-02 19:03:07,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 3915fc90bdf5308f075230d7743aea58, disabling compactions & flushes 2023-10-02 19:03:07,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58. 2023-10-02 19:03:07,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58. 2023-10-02 19:03:07,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58. after waiting 0 ms 2023-10-02 19:03:07,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58. 2023-10-02 19:03:07,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070. 2023-10-02 19:03:07,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070. after waiting 0 ms 2023-10-02 19:03:07,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070. 2023-10-02 19:03:07,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemState/48efd353bc9f50e1acc79ead47002070/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 19:03:07,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemState/3915fc90bdf5308f075230d7743aea58/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 19:03:07,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 19:03:07,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 19:03:07,351 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070. 2023-10-02 19:03:07,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 48efd353bc9f50e1acc79ead47002070: 2023-10-02 19:03:07,352 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58. 2023-10-02 19:03:07,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 3915fc90bdf5308f075230d7743aea58: 2023-10-02 19:03:07,354 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 48efd353bc9f50e1acc79ead47002070 2023-10-02 19:03:07,355 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=48efd353bc9f50e1acc79ead47002070, regionState=CLOSED 2023-10-02 19:03:07,355 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 3915fc90bdf5308f075230d7743aea58 2023-10-02 19:03:07,355 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696273387355"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696273387355"}]},"ts":"1696273387355"} 2023-10-02 19:03:07,356 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=3915fc90bdf5308f075230d7743aea58, regionState=CLOSED 2023-10-02 19:03:07,356 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696273387356"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696273387356"}]},"ts":"1696273387356"} 2023-10-02 19:03:07,361 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=38 2023-10-02 19:03:07,361 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 48efd353bc9f50e1acc79ead47002070, server=jenkins-hbase20.apache.org,34425,1696273349187 in 181 msec 2023-10-02 19:03:07,362 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=37 2023-10-02 19:03:07,362 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 3915fc90bdf5308f075230d7743aea58, server=jenkins-hbase20.apache.org,32897,1696273349258 in 181 msec 2023-10-02 19:03:07,362 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=48efd353bc9f50e1acc79ead47002070, UNASSIGN in 188 msec 2023-10-02 19:03:07,363 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-10-02 19:03:07,364 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3915fc90bdf5308f075230d7743aea58, UNASSIGN in 189 msec 2023-10-02 19:03:07,364 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696273387364"}]},"ts":"1696273387364"} 2023-10-02 19:03:07,366 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-10-02 19:03:07,367 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-10-02 19:03:07,369 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 204 msec 2023-10-02 19:03:07,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-02 19:03:07,473 INFO [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-10-02 19:03:07,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemState 2023-10-02 19:03:07,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-02 19:03:07,481 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-02 19:03:07,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-10-02 19:03:07,482 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-02 19:03:07,484 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34425] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-10-02 19:03:07,486 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 19:03:07,486 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 19:03:07,486 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 19:03:07,486 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 19:03:07,487 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-02 19:03:07,487 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-02 19:03:07,487 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-02 19:03:07,487 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-02 19:03:07,487 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 19:03:07,487 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 19:03:07,487 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:03:07,487 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 19:03:07,487 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:03:07,487 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:03:07,488 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 19:03:07,488 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:03:07,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-02 19:03:07,488 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemState/3915fc90bdf5308f075230d7743aea58 2023-10-02 19:03:07,489 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemState/48efd353bc9f50e1acc79ead47002070 2023-10-02 19:03:07,490 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemState/3915fc90bdf5308f075230d7743aea58/cf, FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemState/3915fc90bdf5308f075230d7743aea58/recovered.edits] 2023-10-02 19:03:07,490 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemState/48efd353bc9f50e1acc79ead47002070/cf, FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemState/48efd353bc9f50e1acc79ead47002070/recovered.edits] 2023-10-02 19:03:07,494 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemState/3915fc90bdf5308f075230d7743aea58/cf/0710eaa484d8485ea84244e284d92b46 to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testExportFileSystemState/3915fc90bdf5308f075230d7743aea58/cf/0710eaa484d8485ea84244e284d92b46 2023-10-02 19:03:07,494 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemState/48efd353bc9f50e1acc79ead47002070/cf/1b4e7c360d2348d58eb20f7339a573ab to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testExportFileSystemState/48efd353bc9f50e1acc79ead47002070/cf/1b4e7c360d2348d58eb20f7339a573ab 2023-10-02 19:03:07,496 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemState/3915fc90bdf5308f075230d7743aea58/recovered.edits/9.seqid to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testExportFileSystemState/3915fc90bdf5308f075230d7743aea58/recovered.edits/9.seqid 2023-10-02 19:03:07,496 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemState/48efd353bc9f50e1acc79ead47002070/recovered.edits/9.seqid to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testExportFileSystemState/48efd353bc9f50e1acc79ead47002070/recovered.edits/9.seqid 2023-10-02 19:03:07,497 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemState/3915fc90bdf5308f075230d7743aea58 2023-10-02 19:03:07,497 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemState/48efd353bc9f50e1acc79ead47002070 2023-10-02 19:03:07,497 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-02 19:03:07,498 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-02 19:03:07,498 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-10-02 19:03:07,502 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310029383392f224540398cfa0ec234a58a0e to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310029383392f224540398cfa0ec234a58a0e 2023-10-02 19:03:07,503 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231002a0cd2326234c4cecab23755a6d7c2cc5 to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231002a0cd2326234c4cecab23755a6d7c2cc5 2023-10-02 19:03:07,503 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-02 19:03:07,506 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-02 19:03:07,508 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-10-02 19:03:07,511 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-10-02 19:03:07,512 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-02 19:03:07,512 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-10-02 19:03:07,512 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696273387512"}]},"ts":"9223372036854775807"} 2023-10-02 19:03:07,512 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696273387512"}]},"ts":"9223372036854775807"} 2023-10-02 19:03:07,515 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-02 19:03:07,515 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3915fc90bdf5308f075230d7743aea58, NAME => 'testtb-testExportFileSystemState,,1696273372630.3915fc90bdf5308f075230d7743aea58.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 48efd353bc9f50e1acc79ead47002070, NAME => 'testtb-testExportFileSystemState,1,1696273372630.48efd353bc9f50e1acc79ead47002070.', STARTKEY => '1', ENDKEY => ''}] 2023-10-02 19:03:07,515 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-10-02 19:03:07,515 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696273387515"}]},"ts":"9223372036854775807"} 2023-10-02 19:03:07,517 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-10-02 19:03:07,519 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-02 19:03:07,521 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 43 msec 2023-10-02 19:03:07,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-02 19:03:07,590 INFO [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-10-02 19:03:07,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportFileSystemState" 2023-10-02 19:03:07,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-10-02 19:03:07,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemState" 2023-10-02 19:03:07,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemState 2023-10-02 19:03:07,623 INFO [Listener at jenkins-hbase20.apache.org/42825] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=770 (was 761) Potentially hanging thread: hconnection-0xb2bac33-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb2bac33-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1470868269) connection to jenkins-hbase20.apache.org/148.251.75.209:42435 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1557508828_17 at /127.0.0.1:38592 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2081 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0xb2bac33-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1021485946_1 at /127.0.0.1:40418 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1517561932_17 at /127.0.0.1:40440 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1557508828_17 at /127.0.0.1:57624 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb2bac33-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1021485946_1 at /127.0.0.1:57600 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=933 (was 942), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=225 (was 215) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=4795 (was 4940) 2023-10-02 19:03:07,623 WARN [Listener at jenkins-hbase20.apache.org/42825] hbase.ResourceChecker(130): Thread=770 is superior to 500 2023-10-02 19:03:07,639 INFO [Listener at jenkins-hbase20.apache.org/42825] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=770, OpenFileDescriptor=933, MaxFileDescriptor=60000, SystemLoadAverage=225, ProcessCount=171, AvailableMemoryMB=4794 2023-10-02 19:03:07,639 WARN [Listener at jenkins-hbase20.apache.org/42825] hbase.ResourceChecker(130): Thread=770 is superior to 500 2023-10-02 19:03:07,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-02 19:03:07,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-10-02 19:03:07,645 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 19:03:07,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-10-02 19:03:07,646 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 19:03:07,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-02 19:03:07,649 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testConsecutiveExports/6c2f0b8fdcbed93086795b7c3e793f6a 2023-10-02 19:03:07,649 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testConsecutiveExports/cc0f487a87584ed2b5d279f01b124e9b 2023-10-02 19:03:07,649 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testConsecutiveExports/6c2f0b8fdcbed93086795b7c3e793f6a empty. 2023-10-02 19:03:07,649 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testConsecutiveExports/cc0f487a87584ed2b5d279f01b124e9b empty. 2023-10-02 19:03:07,650 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testConsecutiveExports/6c2f0b8fdcbed93086795b7c3e793f6a 2023-10-02 19:03:07,650 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testConsecutiveExports/cc0f487a87584ed2b5d279f01b124e9b 2023-10-02 19:03:07,650 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-02 19:03:07,659 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-10-02 19:03:07,660 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6c2f0b8fdcbed93086795b7c3e793f6a, NAME => 'testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp 2023-10-02 19:03:07,661 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => cc0f487a87584ed2b5d279f01b124e9b, NAME => 'testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp 2023-10-02 19:03:07,669 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:03:07,669 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing cc0f487a87584ed2b5d279f01b124e9b, disabling compactions & flushes 2023-10-02 19:03:07,669 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b. 2023-10-02 19:03:07,669 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b. 2023-10-02 19:03:07,669 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b. after waiting 0 ms 2023-10-02 19:03:07,669 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b. 2023-10-02 19:03:07,669 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b. 2023-10-02 19:03:07,669 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for cc0f487a87584ed2b5d279f01b124e9b: 2023-10-02 19:03:07,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-02 19:03:07,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-02 19:03:08,072 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:03:08,072 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 6c2f0b8fdcbed93086795b7c3e793f6a, disabling compactions & flushes 2023-10-02 19:03:08,072 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a. 2023-10-02 19:03:08,072 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a. 2023-10-02 19:03:08,073 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a. after waiting 0 ms 2023-10-02 19:03:08,073 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a. 2023-10-02 19:03:08,073 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a. 2023-10-02 19:03:08,073 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 6c2f0b8fdcbed93086795b7c3e793f6a: 2023-10-02 19:03:08,079 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 19:03:08,080 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696273388080"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696273388080"}]},"ts":"1696273388080"} 2023-10-02 19:03:08,080 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696273388080"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696273388080"}]},"ts":"1696273388080"} 2023-10-02 19:03:08,082 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-02 19:03:08,083 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 19:03:08,084 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696273388084"}]},"ts":"1696273388084"} 2023-10-02 19:03:08,085 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-10-02 19:03:08,088 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-10-02 19:03:08,089 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 19:03:08,089 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 19:03:08,089 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 19:03:08,089 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 19:03:08,090 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6c2f0b8fdcbed93086795b7c3e793f6a, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cc0f487a87584ed2b5d279f01b124e9b, ASSIGN}] 2023-10-02 19:03:08,092 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cc0f487a87584ed2b5d279f01b124e9b, ASSIGN 2023-10-02 19:03:08,093 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6c2f0b8fdcbed93086795b7c3e793f6a, ASSIGN 2023-10-02 19:03:08,094 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6c2f0b8fdcbed93086795b7c3e793f6a, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,32897,1696273349258; forceNewPlan=false, retain=false 2023-10-02 19:03:08,094 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cc0f487a87584ed2b5d279f01b124e9b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38887,1696273349229; forceNewPlan=false, retain=false 2023-10-02 19:03:08,244 INFO [jenkins-hbase20:32777] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-02 19:03:08,248 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=cc0f487a87584ed2b5d279f01b124e9b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:08,248 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=6c2f0b8fdcbed93086795b7c3e793f6a, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:08,248 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696273388248"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696273388248"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696273388248"}]},"ts":"1696273388248"} 2023-10-02 19:03:08,248 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696273388248"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696273388248"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696273388248"}]},"ts":"1696273388248"} 2023-10-02 19:03:08,251 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure cc0f487a87584ed2b5d279f01b124e9b, server=jenkins-hbase20.apache.org,38887,1696273349229}] 2023-10-02 19:03:08,252 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 6c2f0b8fdcbed93086795b7c3e793f6a, server=jenkins-hbase20.apache.org,32897,1696273349258}] 2023-10-02 19:03:08,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-02 19:03:08,415 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a. 2023-10-02 19:03:08,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6c2f0b8fdcbed93086795b7c3e793f6a, NAME => 'testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a.', STARTKEY => '', ENDKEY => '1'} 2023-10-02 19:03:08,416 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b. 2023-10-02 19:03:08,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cc0f487a87584ed2b5d279f01b124e9b, NAME => 'testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b.', STARTKEY => '1', ENDKEY => ''} 2023-10-02 19:03:08,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a. service=AccessControlService 2023-10-02 19:03:08,416 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 19:03:08,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b. service=AccessControlService 2023-10-02 19:03:08,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 6c2f0b8fdcbed93086795b7c3e793f6a 2023-10-02 19:03:08,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:03:08,416 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 19:03:08,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 6c2f0b8fdcbed93086795b7c3e793f6a 2023-10-02 19:03:08,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports cc0f487a87584ed2b5d279f01b124e9b 2023-10-02 19:03:08,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 6c2f0b8fdcbed93086795b7c3e793f6a 2023-10-02 19:03:08,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:03:08,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for cc0f487a87584ed2b5d279f01b124e9b 2023-10-02 19:03:08,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for cc0f487a87584ed2b5d279f01b124e9b 2023-10-02 19:03:08,418 INFO [StoreOpener-cc0f487a87584ed2b5d279f01b124e9b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cc0f487a87584ed2b5d279f01b124e9b 2023-10-02 19:03:08,418 INFO [StoreOpener-6c2f0b8fdcbed93086795b7c3e793f6a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6c2f0b8fdcbed93086795b7c3e793f6a 2023-10-02 19:03:08,419 DEBUG [StoreOpener-cc0f487a87584ed2b5d279f01b124e9b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testConsecutiveExports/cc0f487a87584ed2b5d279f01b124e9b/cf 2023-10-02 19:03:08,419 DEBUG [StoreOpener-cc0f487a87584ed2b5d279f01b124e9b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testConsecutiveExports/cc0f487a87584ed2b5d279f01b124e9b/cf 2023-10-02 19:03:08,419 DEBUG [StoreOpener-6c2f0b8fdcbed93086795b7c3e793f6a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testConsecutiveExports/6c2f0b8fdcbed93086795b7c3e793f6a/cf 2023-10-02 19:03:08,419 DEBUG [StoreOpener-6c2f0b8fdcbed93086795b7c3e793f6a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testConsecutiveExports/6c2f0b8fdcbed93086795b7c3e793f6a/cf 2023-10-02 19:03:08,420 INFO [StoreOpener-6c2f0b8fdcbed93086795b7c3e793f6a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6c2f0b8fdcbed93086795b7c3e793f6a columnFamilyName cf 2023-10-02 19:03:08,420 INFO [StoreOpener-cc0f487a87584ed2b5d279f01b124e9b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc0f487a87584ed2b5d279f01b124e9b columnFamilyName cf 2023-10-02 19:03:08,422 INFO [StoreOpener-6c2f0b8fdcbed93086795b7c3e793f6a-1] regionserver.HStore(310): Store=6c2f0b8fdcbed93086795b7c3e793f6a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 19:03:08,422 INFO [StoreOpener-cc0f487a87584ed2b5d279f01b124e9b-1] regionserver.HStore(310): Store=cc0f487a87584ed2b5d279f01b124e9b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 19:03:08,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testConsecutiveExports/cc0f487a87584ed2b5d279f01b124e9b 2023-10-02 19:03:08,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testConsecutiveExports/6c2f0b8fdcbed93086795b7c3e793f6a 2023-10-02 19:03:08,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testConsecutiveExports/cc0f487a87584ed2b5d279f01b124e9b 2023-10-02 19:03:08,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testConsecutiveExports/6c2f0b8fdcbed93086795b7c3e793f6a 2023-10-02 19:03:08,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for cc0f487a87584ed2b5d279f01b124e9b 2023-10-02 19:03:08,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 6c2f0b8fdcbed93086795b7c3e793f6a 2023-10-02 19:03:08,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testConsecutiveExports/6c2f0b8fdcbed93086795b7c3e793f6a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 19:03:08,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testConsecutiveExports/cc0f487a87584ed2b5d279f01b124e9b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 19:03:08,429 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 6c2f0b8fdcbed93086795b7c3e793f6a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74753648, jitterRate=0.11391615867614746}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 19:03:08,429 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened cc0f487a87584ed2b5d279f01b124e9b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64785136, jitterRate=-0.03462624549865723}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 19:03:08,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 6c2f0b8fdcbed93086795b7c3e793f6a: 2023-10-02 19:03:08,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for cc0f487a87584ed2b5d279f01b124e9b: 2023-10-02 19:03:08,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a., pid=46, masterSystemTime=1696273388407 2023-10-02 19:03:08,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b., pid=45, masterSystemTime=1696273388403 2023-10-02 19:03:08,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b. 2023-10-02 19:03:08,431 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b. 2023-10-02 19:03:08,432 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=cc0f487a87584ed2b5d279f01b124e9b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:08,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a. 2023-10-02 19:03:08,432 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a. 2023-10-02 19:03:08,432 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696273388432"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696273388432"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696273388432"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696273388432"}]},"ts":"1696273388432"} 2023-10-02 19:03:08,433 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=6c2f0b8fdcbed93086795b7c3e793f6a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:08,433 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696273388433"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696273388433"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696273388433"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696273388433"}]},"ts":"1696273388433"} 2023-10-02 19:03:08,436 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-10-02 19:03:08,436 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure cc0f487a87584ed2b5d279f01b124e9b, server=jenkins-hbase20.apache.org,38887,1696273349229 in 183 msec 2023-10-02 19:03:08,436 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=43 2023-10-02 19:03:08,436 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 6c2f0b8fdcbed93086795b7c3e793f6a, server=jenkins-hbase20.apache.org,32897,1696273349258 in 182 msec 2023-10-02 19:03:08,437 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cc0f487a87584ed2b5d279f01b124e9b, ASSIGN in 347 msec 2023-10-02 19:03:08,438 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=43, resume processing ppid=42 2023-10-02 19:03:08,438 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6c2f0b8fdcbed93086795b7c3e793f6a, ASSIGN in 347 msec 2023-10-02 19:03:08,439 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 19:03:08,439 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696273388439"}]},"ts":"1696273388439"} 2023-10-02 19:03:08,440 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-10-02 19:03:08,442 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 19:03:08,443 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-10-02 19:03:08,445 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34425] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-02 19:03:08,446 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:03:08,446 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:03:08,446 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:03:08,446 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:03:08,447 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-02 19:03:08,447 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-02 19:03:08,447 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-02 19:03:08,447 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-02 19:03:08,448 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 806 msec 2023-10-02 19:03:08,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-02 19:03:08,756 INFO [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-10-02 19:03:08,763 DEBUG [Listener at jenkins-hbase20.apache.org/42825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-02 19:03:08,764 DEBUG [Listener at jenkins-hbase20.apache.org/42825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a. 2023-10-02 19:03:08,766 INFO [Listener at jenkins-hbase20.apache.org/42825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 19:03:08,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-02 19:03:08,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696273388782 (current time:1696273388782). 2023-10-02 19:03:08,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 19:03:08,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(139): Connect 0x009618d2 to 127.0.0.1:60248 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 19:03:08,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@102d7ee1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 19:03:08,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:03:08,793 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36296, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:03:08,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x009618d2 to 127.0.0.1:60248 2023-10-02 19:03:08,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:03:08,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(139): Connect 0x195d0693 to 127.0.0.1:60248 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 19:03:08,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@293dcde2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 19:03:08,808 DEBUG [hconnection-0x529c7452-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:03:08,812 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36306, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:03:08,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:03:08,820 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37808, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:03:08,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x195d0693 to 127.0.0.1:60248 2023-10-02 19:03:08,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:03:08,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-02 19:03:08,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 19:03:08,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-02 19:03:08,825 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot, current working dir path: hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 19:03:08,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-02 19:03:08,829 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-02 19:03:08,830 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696273988830 2023-10-02 19:03:08,830 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-02 19:03:08,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-02 19:03:08,832 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 19:03:08,832 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 19:03:08,832 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-02 19:03:08,836 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-02 19:03:08,838 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 10 msec 2023-10-02 19:03:08,840 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-02 19:03:08,841 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696273988841 2023-10-02 19:03:08,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,850 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-10-02 19:03:08,850 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:03:08,851 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-10-02 19:03:08,851 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-02 19:03:08,852 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,852 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,852 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:08,852 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:08,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:08,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:08,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:08,852 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:08,852 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:08,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:08,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:08,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:08,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,853 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:08,853 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:08,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,853 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,853 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:08,853 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 19:03:08,853 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-02 19:03:08,854 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,854 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-02 19:03:08,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-02 19:03:08,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-02 19:03:08,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,854 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,854 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-02 19:03:08,854 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-02 19:03:08,854 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-02 19:03:08,854 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:03:08,854 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,855 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-02 19:03:08,856 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-02 19:03:08,856 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,856 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:03:08,856 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-02 19:03:08,857 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-02 19:03:08,857 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-02 19:03:08,856 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-02 19:03:08,857 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:03:08,857 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,32897,1696273349258' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-02 19:03:08,857 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34425,1696273349187' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-02 19:03:08,860 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-02 19:03:08,860 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-02 19:03:08,860 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38887,1696273349229' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-02 19:03:08,866 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,866 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,866 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:08,866 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:08,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:08,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:03:08,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:03:08,867 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,867 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,867 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:03:08,867 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,867 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:03:08,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:03:08,867 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,867 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:03:08,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:03:08,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:08,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:08,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:08,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:03:08,868 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38887,1696273349229' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-02 19:03:08,868 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d035c3a[Count = 1] remaining members to acquire global barrier 2023-10-02 19:03:08,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:08,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:03:08,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:03:08,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:03:08,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:03:08,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:08,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:08,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:08,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:03:08,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,32897,1696273349258' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-02 19:03:08,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d035c3a[Count = 0] remaining members to acquire global barrier 2023-10-02 19:03:08,870 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-02 19:03:08,870 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,872 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,872 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,872 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,873 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:08,873 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-02 19:03:08,873 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-02 19:03:08,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,873 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-02 19:03:08,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,873 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 19:03:08,873 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b. 2023-10-02 19:03:08,873 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,34425,1696273349187' in zk 2023-10-02 19:03:08,873 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b. started... 2023-10-02 19:03:08,873 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:08,873 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 19:03:08,873 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 19:03:08,873 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-02 19:03:08,875 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cc0f487a87584ed2b5d279f01b124e9b: 2023-10-02 19:03:08,875 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 19:03:08,875 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 19:03:08,875 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a. 2023-10-02 19:03:08,875 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,875 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a. started... 2023-10-02 19:03:08,876 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 19:03:08,876 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 19:03:08,877 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6c2f0b8fdcbed93086795b7c3e793f6a: 2023-10-02 19:03:08,877 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,877 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 19:03:08,877 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 19:03:08,883 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-02 19:03:08,883 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:03:08,883 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-02 19:03:08,893 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a. completed. 2023-10-02 19:03:08,893 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a. 2023-10-02 19:03:08,893 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 19:03:08,894 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 19:03:08,893 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b. completed. 2023-10-02 19:03:08,894 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:08,894 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b. 2023-10-02 19:03:08,894 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-02 19:03:08,894 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 19:03:08,894 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 19:03:08,894 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,32897,1696273349258' in zk 2023-10-02 19:03:08,894 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:08,894 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-02 19:03:08,894 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,38887,1696273349229' in zk 2023-10-02 19:03:08,895 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-02 19:03:08,895 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:08,895 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:03:08,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:08,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:03:08,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:03:08,895 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-02 19:03:08,895 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:08,897 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:03:08,895 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-02 19:03:08,897 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-02 19:03:08,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:03:08,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:03:08,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:08,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:08,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:08,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:03:08,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:08,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:08,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:08,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,32897,1696273349258': 2023-10-02 19:03:08,900 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,32897,1696273349258' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-02 19:03:08,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:08,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:03:08,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:03:08,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:03:08,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:03:08,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:08,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:08,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:08,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:03:08,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:08,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:08,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:08,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,38887,1696273349229': 2023-10-02 19:03:08,904 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38887,1696273349229' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-02 19:03:08,904 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-10-02 19:03:08,904 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 19:03:08,904 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 19:03:08,904 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,904 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 19:03:08,914 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,914 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,914 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:08,914 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,914 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,915 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:08,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:03:08,915 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:08,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,915 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:08,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:08,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:08,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:03:08,916 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:08,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:08,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:08,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:08,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:03:08,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:08,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,916 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:08,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:03:08,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:08,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:08,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:08,919 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:08,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:03:08,919 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:08,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:08,920 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:08,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:08,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:08,923 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:08,923 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,923 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:08,923 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:08,923 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:08,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:08,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:08,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:08,923 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:08,923 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:08,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:08,923 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:08,923 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:08,924 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:08,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:08,924 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:08,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:08,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:08,923 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,923 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:03:08,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:08,924 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-02 19:03:08,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:08,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,924 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:08,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:08,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:08,926 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 19:03:08,926 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:08,926 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:08,926 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,926 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,927 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-02 19:03:08,932 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 19:03:08,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-02 19:03:08,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-02 19:03:08,934 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 19:03:08,940 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,941 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,962 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,962 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-02 19:03:08,962 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,963 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:08,963 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696273388830Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696273388940 (+110 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1696273388940Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1696273388940Writing data manifest for emptySnaptb0-testConsecutiveExports at 1696273388944 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1696273388956 (+12 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696273388962 (+6 ms) 2023-10-02 19:03:08,965 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-02 19:03:08,966 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 134 msec 2023-10-02 19:03:09,134 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 19:03:09,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-02 19:03:09,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 19:03:09,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32897] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 19:03:09,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38887] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 19:03:09,150 DEBUG [Listener at jenkins-hbase20.apache.org/42825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-02 19:03:09,150 DEBUG [Listener at jenkins-hbase20.apache.org/42825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a. 2023-10-02 19:03:09,151 INFO [Listener at jenkins-hbase20.apache.org/42825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 19:03:09,162 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-02 19:03:09,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696273389162 (current time:1696273389162). 2023-10-02 19:03:09,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 19:03:09,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(139): Connect 0x7fd691a6 to 127.0.0.1:60248 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 19:03:09,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56e5656a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 19:03:09,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:03:09,176 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36322, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:03:09,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7fd691a6 to 127.0.0.1:60248 2023-10-02 19:03:09,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:03:09,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(139): Connect 0x6b50226c to 127.0.0.1:60248 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 19:03:09,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20c0c501, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 19:03:09,194 DEBUG [hconnection-0x5df33a46-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:03:09,198 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36326, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:03:09,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:03:09,204 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37824, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:03:09,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b50226c to 127.0.0.1:60248 2023-10-02 19:03:09,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:03:09,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-02 19:03:09,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 19:03:09,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-02 19:03:09,210 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot, current working dir path: hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 19:03:09,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-02 19:03:09,213 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-02 19:03:09,214 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696273989214 2023-10-02 19:03:09,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-02 19:03:09,214 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-02 19:03:09,216 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 19:03:09,216 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 19:03:09,216 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-02 19:03:09,218 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-02 19:03:09,220 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-10-02 19:03:09,221 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-02 19:03:09,222 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696273989222 2023-10-02 19:03:09,235 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-10-02 19:03:09,235 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-10-02 19:03:09,235 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:03:09,237 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-10-02 19:03:09,237 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-02 19:03:09,237 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,237 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,238 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:09,238 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:09,238 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:09,238 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:09,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:09,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:09,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:09,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:09,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:09,238 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:09,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:09,239 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:09,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,239 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:09,239 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,239 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 19:03:09,239 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,239 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-02 19:03:09,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-02 19:03:09,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-02 19:03:09,240 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-02 19:03:09,240 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-02 19:03:09,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,240 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-02 19:03:09,240 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-02 19:03:09,240 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-02 19:03:09,240 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-02 19:03:09,240 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-02 19:03:09,240 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:03:09,240 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-02 19:03:09,240 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:03:09,240 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-02 19:03:09,242 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-02 19:03:09,243 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-02 19:03:09,243 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34425,1696273349187' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-02 19:03:09,243 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:03:09,243 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-02 19:03:09,244 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-02 19:03:09,244 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-02 19:03:09,244 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-02 19:03:09,244 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38887,1696273349229' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-02 19:03:09,244 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,32897,1696273349258' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-02 19:03:09,248 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,248 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,248 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,248 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:09,248 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:09,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:09,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:03:09,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:03:09,248 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,248 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:03:09,248 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,248 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,248 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:03:09,248 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:03:09,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:03:09,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:03:09,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 19:03:09,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:09,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:09,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:09,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:03:09,250 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38887,1696273349229' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-02 19:03:09,250 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5fe6fbd9[Count = 1] remaining members to acquire global barrier 2023-10-02 19:03:09,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:09,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:03:09,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:03:09,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:03:09,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:03:09,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 19:03:09,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:09,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:09,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:09,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:03:09,252 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,32897,1696273349258' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-02 19:03:09,252 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5fe6fbd9[Count = 0] remaining members to acquire global barrier 2023-10-02 19:03:09,252 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-02 19:03:09,252 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,256 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,256 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,256 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,256 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-02 19:03:09,256 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-02 19:03:09,256 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-02 19:03:09,256 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:09,257 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 19:03:09,257 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 19:03:09,257 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a. 2023-10-02 19:03:09,257 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b. 2023-10-02 19:03:09,257 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 19:03:09,257 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 19:03:09,257 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-02 19:03:09,257 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:09,257 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 19:03:09,257 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b. started... 2023-10-02 19:03:09,257 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a. started... 2023-10-02 19:03:09,257 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,34425,1696273349187' in zk 2023-10-02 19:03:09,257 INFO [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6c2f0b8fdcbed93086795b7c3e793f6a 1/1 column families, dataSize=467 B heapSize=1.23 KB 2023-10-02 19:03:09,257 INFO [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cc0f487a87584ed2b5d279f01b124e9b 1/1 column families, dataSize=2.80 KB heapSize=6.30 KB 2023-10-02 19:03:09,259 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-02 19:03:09,259 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:03:09,259 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-02 19:03:09,295 INFO [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231002e522b4a4e2d844d28a0b72ad42d42de2 to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231002e522b4a4e2d844d28a0b72ad42d42de2 2023-10-02 19:03:09,295 INFO [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310022359f46c4f4d4fd98bfa4a2de9d800ab to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310022359f46c4f4d4fd98bfa4a2de9d800ab 2023-10-02 19:03:09,308 INFO [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=467, hasBloomFilter=true, into tmp file hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testConsecutiveExports/6c2f0b8fdcbed93086795b7c3e793f6a/.tmp/cf/09545938229d40e2b761aed86eba152e 2023-10-02 19:03:09,309 INFO [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.8 K, hasBloomFilter=true, into tmp file hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testConsecutiveExports/cc0f487a87584ed2b5d279f01b124e9b/.tmp/cf/d6866b2bdef6424fb0499586049543d3 2023-10-02 19:03:09,313 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testConsecutiveExports/6c2f0b8fdcbed93086795b7c3e793f6a/.tmp/cf/09545938229d40e2b761aed86eba152e as hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testConsecutiveExports/6c2f0b8fdcbed93086795b7c3e793f6a/cf/09545938229d40e2b761aed86eba152e 2023-10-02 19:03:09,314 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testConsecutiveExports/cc0f487a87584ed2b5d279f01b124e9b/.tmp/cf/d6866b2bdef6424fb0499586049543d3 as hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testConsecutiveExports/cc0f487a87584ed2b5d279f01b124e9b/cf/d6866b2bdef6424fb0499586049543d3 2023-10-02 19:03:09,316 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 19:03:09,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-02 19:03:09,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-02 19:03:09,318 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 19:03:09,321 INFO [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testConsecutiveExports/6c2f0b8fdcbed93086795b7c3e793f6a/cf/09545938229d40e2b761aed86eba152e, entries=7, sequenceid=6, filesize=6.1 K 2023-10-02 19:03:09,321 INFO [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testConsecutiveExports/cc0f487a87584ed2b5d279f01b124e9b/cf/d6866b2bdef6424fb0499586049543d3, entries=43, sequenceid=6, filesize=12.0 K 2023-10-02 19:03:09,322 INFO [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~467 B/467, heapSize ~1.22 KB/1248, currentSize=0 B/0 for 6c2f0b8fdcbed93086795b7c3e793f6a in 65ms, sequenceid=6, compaction requested=false 2023-10-02 19:03:09,322 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-10-02 19:03:09,322 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6c2f0b8fdcbed93086795b7c3e793f6a: 2023-10-02 19:03:09,322 INFO [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.80 KB/2869, heapSize ~6.28 KB/6432, currentSize=0 B/0 for cc0f487a87584ed2b5d279f01b124e9b in 65ms, sequenceid=6, compaction requested=false 2023-10-02 19:03:09,324 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cc0f487a87584ed2b5d279f01b124e9b: 2023-10-02 19:03:09,324 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-02 19:03:09,324 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-02 19:03:09,324 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 19:03:09,324 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 19:03:09,324 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testConsecutiveExports/6c2f0b8fdcbed93086795b7c3e793f6a/cf/09545938229d40e2b761aed86eba152e] hfiles 2023-10-02 19:03:09,324 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testConsecutiveExports/cc0f487a87584ed2b5d279f01b124e9b/cf/d6866b2bdef6424fb0499586049543d3] hfiles 2023-10-02 19:03:09,324 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testConsecutiveExports/6c2f0b8fdcbed93086795b7c3e793f6a/cf/09545938229d40e2b761aed86eba152e for snapshot=snaptb0-testConsecutiveExports 2023-10-02 19:03:09,324 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testConsecutiveExports/cc0f487a87584ed2b5d279f01b124e9b/cf/d6866b2bdef6424fb0499586049543d3 for snapshot=snaptb0-testConsecutiveExports 2023-10-02 19:03:09,338 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a. completed. 2023-10-02 19:03:09,338 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a. 2023-10-02 19:03:09,338 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 19:03:09,338 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 19:03:09,338 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b. completed. 2023-10-02 19:03:09,338 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:09,338 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b. 2023-10-02 19:03:09,338 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-02 19:03:09,338 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 19:03:09,338 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 19:03:09,338 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,32897,1696273349258' in zk 2023-10-02 19:03:09,338 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:09,338 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-02 19:03:09,338 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,38887,1696273349229' in zk 2023-10-02 19:03:09,339 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:09,339 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-02 19:03:09,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:09,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:03:09,340 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:03:09,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:03:09,340 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-02 19:03:09,341 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:03:09,340 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:09,341 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-02 19:03:09,340 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-02 19:03:09,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:03:09,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:03:09,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 19:03:09,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:09,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:09,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:09,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:03:09,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 19:03:09,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:09,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:09,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:09,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,38887,1696273349229': 2023-10-02 19:03:09,346 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38887,1696273349229' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-02 19:03:09,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:09,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:03:09,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:03:09,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:03:09,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:03:09,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 19:03:09,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:09,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:09,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:09,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:03:09,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 19:03:09,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:09,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:09,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:09,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,32897,1696273349258': 2023-10-02 19:03:09,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,32897,1696273349258' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-02 19:03:09,349 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-10-02 19:03:09,349 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 19:03:09,349 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 19:03:09,349 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-10-02 19:03:09,349 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 19:03:09,356 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,356 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,356 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:03:09,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:03:09,356 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,356 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:09,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,356 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:09,357 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:09,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:03:09,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,356 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:09,357 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:09,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 19:03:09,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:09,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:09,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:09,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:09,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:09,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:09,357 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:09,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:03:09,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 19:03:09,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:09,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:09,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:09,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:03:09,359 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:09,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 19:03:09,360 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:09,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:09,360 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:09,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:09,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:09,368 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:09,368 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:09,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:09,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:09,368 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:09,368 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:03:09,368 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:09,368 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-10-02 19:03:09,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:09,368 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:09,368 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:09,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:09,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:09,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:09,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:09,370 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:09,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:09,370 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-02 19:03:09,368 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:09,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-02 19:03:09,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:09,371 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:09,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:09,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:09,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 19:03:09,371 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:09,371 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,371 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:09,371 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,371 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:09,371 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:09,371 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,371 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231002e522b4a4e2d844d28a0b72ad42d42de2, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310022359f46c4f4d4fd98bfa4a2de9d800ab] mob files 2023-10-02 19:03:09,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231002e522b4a4e2d844d28a0b72ad42d42de2 2023-10-02 19:03:09,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310022359f46c4f4d4fd98bfa4a2de9d800ab 2023-10-02 19:03:09,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-10-02 19:03:09,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,396 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,397 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-02 19:03:09,397 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,398 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,398 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696273389214Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696273389379 (+165 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1696273389379Loading Region manifests for snaptb0-testConsecutiveExports at 1696273389379Writing data manifest for snaptb0-testConsecutiveExports at 1696273389383 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1696273389390 (+7 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696273389397 (+7 ms) 2023-10-02 19:03:09,399 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-02 19:03:09,401 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 183 msec 2023-10-02 19:03:09,518 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 19:03:09,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-02 19:03:09,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 19:03:09,522 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/local-export-1696273389522 2023-10-02 19:03:09,523 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/local-export-1696273389522, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/local-export-1696273389522, srcFsUri=hdfs://localhost:46307, srcDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6 2023-10-02 19:03:09,545 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46307, inputRoot=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6 2023-10-02 19:03:09,545 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@757720db, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/local-export-1696273389522, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/local-export-1696273389522/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,545 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46307, inputRoot=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6, snapshotDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-02 19:03:09,553 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/local-export-1696273389522/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-02 19:03:09,563 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:09,563 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:09,564 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:09,564 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:10,272 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/hadoop-2233706804669799043.jar 2023-10-02 19:03:10,273 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:10,273 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:10,327 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/hadoop-3439365152041419168.jar 2023-10-02 19:03:10,328 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:10,328 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:10,328 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:10,329 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:10,329 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:10,329 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:10,330 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-02 19:03:10,330 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-02 19:03:10,330 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-02 19:03:10,330 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-02 19:03:10,331 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-02 19:03:10,331 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-02 19:03:10,331 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-02 19:03:10,332 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-02 19:03:10,332 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-02 19:03:10,332 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-02 19:03:10,333 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 19:03:10,333 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 19:03:10,334 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 19:03:10,334 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 19:03:10,334 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 19:03:10,335 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 19:03:10,335 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 19:03:11,082 WARN [Listener at jenkins-hbase20.apache.org/42825] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-02 19:03:11,085 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-02 19:03:11,087 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-02 19:03:11,718 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 19:03:11,718 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 19:03:11,724 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696273355352_0002_000001 (auth:SIMPLE) 2023-10-02 19:03:11,938 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696273355352_0003_000001 (auth:SIMPLE) 2023-10-02 19:03:12,953 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-02 19:03:15,378 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696273355352_0003_000001 (auth:SIMPLE) 2023-10-02 19:03:17,575 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696273355352_0003_000001 (auth:SIMPLE) 2023-10-02 19:03:20,179 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696273355352_0003_000001 (auth:SIMPLE) 2023-10-02 19:03:21,256 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-02 19:03:21,256 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-02 19:03:21,259 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-02 19:03:21,260 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-02 19:03:21,260 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-02 19:03:21,260 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1557508828_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-02 19:03:21,263 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(367): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-02 19:03:21,263 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(367): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-02 19:03:21,263 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@19f3ee21 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/local-export-1696273389522/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/local-export-1696273389522/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-02 19:03:21,263 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/local-export-1696273389522/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-02 19:03:21,263 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/local-export-1696273389522/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-02 19:03:21,264 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/local-export-1696273389522, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/local-export-1696273389522, srcFsUri=hdfs://localhost:46307, srcDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6 2023-10-02 19:03:21,282 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46307, inputRoot=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6 2023-10-02 19:03:21,282 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@43bcd6d, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/local-export-1696273389522, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/local-export-1696273389522/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-02 19:03:21,282 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46307, inputRoot=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6, snapshotDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-02 19:03:21,294 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/local-export-1696273389522/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-02 19:03:21,304 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:21,304 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:21,305 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:21,305 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:22,011 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/hadoop-1420554225192038901.jar 2023-10-02 19:03:22,011 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:22,012 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:22,066 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/hadoop-3974404284514180036.jar 2023-10-02 19:03:22,066 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:22,066 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:22,067 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:22,067 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:22,067 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:22,067 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:22,068 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-02 19:03:22,068 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-02 19:03:22,069 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-02 19:03:22,069 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-02 19:03:22,069 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-02 19:03:22,070 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-02 19:03:22,070 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-02 19:03:22,070 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-02 19:03:22,070 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-02 19:03:22,071 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-02 19:03:22,071 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 19:03:22,072 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 19:03:22,072 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 19:03:22,072 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 19:03:22,072 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 19:03:22,073 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 19:03:22,073 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 19:03:22,410 WARN [Listener at jenkins-hbase20.apache.org/42825] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-02 19:03:22,412 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-02 19:03:22,414 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-02 19:03:26,378 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 19:03:26,378 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 19:03:26,380 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696273355352_0003_000001 (auth:SIMPLE) 2023-10-02 19:03:27,147 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696273355352_0004_000001 (auth:SIMPLE) 2023-10-02 19:03:30,496 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696273355352_0004_000001 (auth:SIMPLE) 2023-10-02 19:03:32,703 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696273355352_0004_000001 (auth:SIMPLE) 2023-10-02 19:03:34,668 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696273355352_0004_000001 (auth:SIMPLE) 2023-10-02 19:03:34,679 WARN [ContainersLauncher #1] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1696273355352_0004_01_000002 is : 143 2023-10-02 19:03:36,614 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-02 19:03:36,615 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-02 19:03:36,617 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-02 19:03:36,617 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-02 19:03:36,617 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-02 19:03:36,617 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1557508828_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-02 19:03:36,619 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(367): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-02 19:03:36,619 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(367): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-02 19:03:36,619 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@19f3ee21 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/local-export-1696273389522/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/local-export-1696273389522/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-02 19:03:36,620 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/local-export-1696273389522/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-02 19:03:36,620 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/local-export-1696273389522/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-02 19:03:36,631 INFO [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-10-02 19:03:36,632 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testConsecutiveExports 2023-10-02 19:03:36,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-10-02 19:03:36,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-02 19:03:36,636 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696273416636"}]},"ts":"1696273416636"} 2023-10-02 19:03:36,637 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-10-02 19:03:36,638 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-10-02 19:03:36,639 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6c2f0b8fdcbed93086795b7c3e793f6a, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cc0f487a87584ed2b5d279f01b124e9b, UNASSIGN}] 2023-10-02 19:03:36,641 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6c2f0b8fdcbed93086795b7c3e793f6a, UNASSIGN 2023-10-02 19:03:36,641 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cc0f487a87584ed2b5d279f01b124e9b, UNASSIGN 2023-10-02 19:03:36,642 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=cc0f487a87584ed2b5d279f01b124e9b, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:36,642 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=6c2f0b8fdcbed93086795b7c3e793f6a, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:36,642 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696273416642"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696273416642"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696273416642"}]},"ts":"1696273416642"} 2023-10-02 19:03:36,642 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696273416642"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696273416642"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696273416642"}]},"ts":"1696273416642"} 2023-10-02 19:03:36,644 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure cc0f487a87584ed2b5d279f01b124e9b, server=jenkins-hbase20.apache.org,38887,1696273349229}] 2023-10-02 19:03:36,644 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 6c2f0b8fdcbed93086795b7c3e793f6a, server=jenkins-hbase20.apache.org,32897,1696273349258}] 2023-10-02 19:03:36,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-02 19:03:36,796 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close cc0f487a87584ed2b5d279f01b124e9b 2023-10-02 19:03:36,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing cc0f487a87584ed2b5d279f01b124e9b, disabling compactions & flushes 2023-10-02 19:03:36,796 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b. 2023-10-02 19:03:36,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b. 2023-10-02 19:03:36,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b. after waiting 0 ms 2023-10-02 19:03:36,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b. 2023-10-02 19:03:36,797 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 6c2f0b8fdcbed93086795b7c3e793f6a 2023-10-02 19:03:36,797 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 6c2f0b8fdcbed93086795b7c3e793f6a, disabling compactions & flushes 2023-10-02 19:03:36,797 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a. 2023-10-02 19:03:36,797 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a. 2023-10-02 19:03:36,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a. after waiting 0 ms 2023-10-02 19:03:36,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a. 2023-10-02 19:03:36,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testConsecutiveExports/cc0f487a87584ed2b5d279f01b124e9b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 19:03:36,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testConsecutiveExports/6c2f0b8fdcbed93086795b7c3e793f6a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 19:03:36,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 19:03:36,812 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b. 2023-10-02 19:03:36,812 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for cc0f487a87584ed2b5d279f01b124e9b: 2023-10-02 19:03:36,813 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 19:03:36,814 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a. 2023-10-02 19:03:36,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 6c2f0b8fdcbed93086795b7c3e793f6a: 2023-10-02 19:03:36,815 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed cc0f487a87584ed2b5d279f01b124e9b 2023-10-02 19:03:36,816 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=cc0f487a87584ed2b5d279f01b124e9b, regionState=CLOSED 2023-10-02 19:03:36,816 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696273416816"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696273416816"}]},"ts":"1696273416816"} 2023-10-02 19:03:36,816 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 6c2f0b8fdcbed93086795b7c3e793f6a 2023-10-02 19:03:36,816 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=6c2f0b8fdcbed93086795b7c3e793f6a, regionState=CLOSED 2023-10-02 19:03:36,816 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696273416816"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696273416816"}]},"ts":"1696273416816"} 2023-10-02 19:03:36,819 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=53 2023-10-02 19:03:36,819 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure cc0f487a87584ed2b5d279f01b124e9b, server=jenkins-hbase20.apache.org,38887,1696273349229 in 173 msec 2023-10-02 19:03:36,820 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=52 2023-10-02 19:03:36,820 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 6c2f0b8fdcbed93086795b7c3e793f6a, server=jenkins-hbase20.apache.org,32897,1696273349258 in 174 msec 2023-10-02 19:03:36,821 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cc0f487a87584ed2b5d279f01b124e9b, UNASSIGN in 180 msec 2023-10-02 19:03:36,822 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-10-02 19:03:36,822 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6c2f0b8fdcbed93086795b7c3e793f6a, UNASSIGN in 181 msec 2023-10-02 19:03:36,822 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696273416822"}]},"ts":"1696273416822"} 2023-10-02 19:03:36,823 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-10-02 19:03:36,825 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-10-02 19:03:36,827 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 193 msec 2023-10-02 19:03:36,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-02 19:03:36,939 INFO [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-10-02 19:03:36,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testConsecutiveExports 2023-10-02 19:03:36,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-02 19:03:36,946 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-02 19:03:36,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-10-02 19:03:36,948 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-02 19:03:36,949 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34425] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-10-02 19:03:36,952 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-02 19:03:36,952 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-02 19:03:36,952 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-02 19:03:36,952 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-02 19:03:36,953 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-02 19:03:36,953 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-02 19:03:36,953 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-02 19:03:36,953 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-02 19:03:36,953 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-02 19:03:36,953 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-02 19:03:36,953 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:03:36,953 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:03:36,954 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-02 19:03:36,954 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:03:36,954 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-02 19:03:36,954 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:03:36,954 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testConsecutiveExports/6c2f0b8fdcbed93086795b7c3e793f6a 2023-10-02 19:03:36,954 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testConsecutiveExports/cc0f487a87584ed2b5d279f01b124e9b 2023-10-02 19:03:36,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-02 19:03:36,957 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testConsecutiveExports/cc0f487a87584ed2b5d279f01b124e9b/cf, FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testConsecutiveExports/cc0f487a87584ed2b5d279f01b124e9b/recovered.edits] 2023-10-02 19:03:36,957 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testConsecutiveExports/6c2f0b8fdcbed93086795b7c3e793f6a/cf, FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testConsecutiveExports/6c2f0b8fdcbed93086795b7c3e793f6a/recovered.edits] 2023-10-02 19:03:36,961 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testConsecutiveExports/cc0f487a87584ed2b5d279f01b124e9b/cf/d6866b2bdef6424fb0499586049543d3 to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testConsecutiveExports/cc0f487a87584ed2b5d279f01b124e9b/cf/d6866b2bdef6424fb0499586049543d3 2023-10-02 19:03:36,962 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testConsecutiveExports/6c2f0b8fdcbed93086795b7c3e793f6a/cf/09545938229d40e2b761aed86eba152e to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testConsecutiveExports/6c2f0b8fdcbed93086795b7c3e793f6a/cf/09545938229d40e2b761aed86eba152e 2023-10-02 19:03:36,964 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testConsecutiveExports/cc0f487a87584ed2b5d279f01b124e9b/recovered.edits/9.seqid to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testConsecutiveExports/cc0f487a87584ed2b5d279f01b124e9b/recovered.edits/9.seqid 2023-10-02 19:03:36,964 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testConsecutiveExports/6c2f0b8fdcbed93086795b7c3e793f6a/recovered.edits/9.seqid to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testConsecutiveExports/6c2f0b8fdcbed93086795b7c3e793f6a/recovered.edits/9.seqid 2023-10-02 19:03:36,966 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testConsecutiveExports/cc0f487a87584ed2b5d279f01b124e9b 2023-10-02 19:03:36,966 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testConsecutiveExports/6c2f0b8fdcbed93086795b7c3e793f6a 2023-10-02 19:03:36,966 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-02 19:03:36,966 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-02 19:03:36,967 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-10-02 19:03:36,970 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231002e522b4a4e2d844d28a0b72ad42d42de2 to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231002e522b4a4e2d844d28a0b72ad42d42de2 2023-10-02 19:03:36,972 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310022359f46c4f4d4fd98bfa4a2de9d800ab to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310022359f46c4f4d4fd98bfa4a2de9d800ab 2023-10-02 19:03:36,972 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-02 19:03:36,975 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-02 19:03:36,977 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-10-02 19:03:36,979 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-10-02 19:03:36,981 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-02 19:03:36,981 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-10-02 19:03:36,981 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696273416981"}]},"ts":"9223372036854775807"} 2023-10-02 19:03:36,981 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696273416981"}]},"ts":"9223372036854775807"} 2023-10-02 19:03:36,983 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-02 19:03:36,983 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6c2f0b8fdcbed93086795b7c3e793f6a, NAME => 'testtb-testConsecutiveExports,,1696273387641.6c2f0b8fdcbed93086795b7c3e793f6a.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => cc0f487a87584ed2b5d279f01b124e9b, NAME => 'testtb-testConsecutiveExports,1,1696273387641.cc0f487a87584ed2b5d279f01b124e9b.', STARTKEY => '1', ENDKEY => ''}] 2023-10-02 19:03:36,983 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-10-02 19:03:36,983 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696273416983"}]},"ts":"9223372036854775807"} 2023-10-02 19:03:36,985 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-10-02 19:03:36,986 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-02 19:03:36,988 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 45 msec 2023-10-02 19:03:37,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-02 19:03:37,056 INFO [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-10-02 19:03:37,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testConsecutiveExports" 2023-10-02 19:03:37,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-10-02 19:03:37,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testConsecutiveExports" 2023-10-02 19:03:37,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testConsecutiveExports 2023-10-02 19:03:37,090 INFO [Listener at jenkins-hbase20.apache.org/42825] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=756 (was 770), OpenFileDescriptor=911 (was 933), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=242 (was 225) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 171), AvailableMemoryMB=4621 (was 4794) 2023-10-02 19:03:37,090 WARN [Listener at jenkins-hbase20.apache.org/42825] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-10-02 19:03:37,108 INFO [Listener at jenkins-hbase20.apache.org/42825] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=756, OpenFileDescriptor=911, MaxFileDescriptor=60000, SystemLoadAverage=242, ProcessCount=169, AvailableMemoryMB=4620 2023-10-02 19:03:37,109 WARN [Listener at jenkins-hbase20.apache.org/42825] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-10-02 19:03:37,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-02 19:03:37,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,114 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 19:03:37,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-10-02 19:03:37,115 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 19:03:37,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-02 19:03:37,118 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/53012b5690776af2ad146320d66230af 2023-10-02 19:03:37,118 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/85caf1edfad4e9697da715af22456943 2023-10-02 19:03:37,119 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/53012b5690776af2ad146320d66230af empty. 2023-10-02 19:03:37,119 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/85caf1edfad4e9697da715af22456943 empty. 2023-10-02 19:03:37,120 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/53012b5690776af2ad146320d66230af 2023-10-02 19:03:37,120 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/85caf1edfad4e9697da715af22456943 2023-10-02 19:03:37,120 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-02 19:03:37,132 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-10-02 19:03:37,133 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 85caf1edfad4e9697da715af22456943, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp 2023-10-02 19:03:37,133 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 53012b5690776af2ad146320d66230af, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp 2023-10-02 19:03:37,145 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:03:37,145 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:03:37,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 53012b5690776af2ad146320d66230af, disabling compactions & flushes 2023-10-02 19:03:37,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 85caf1edfad4e9697da715af22456943, disabling compactions & flushes 2023-10-02 19:03:37,146 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af. 2023-10-02 19:03:37,146 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943. 2023-10-02 19:03:37,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af. 2023-10-02 19:03:37,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943. 2023-10-02 19:03:37,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af. after waiting 0 ms 2023-10-02 19:03:37,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943. after waiting 0 ms 2023-10-02 19:03:37,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af. 2023-10-02 19:03:37,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943. 2023-10-02 19:03:37,146 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af. 2023-10-02 19:03:37,146 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943. 2023-10-02 19:03:37,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 53012b5690776af2ad146320d66230af: 2023-10-02 19:03:37,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 85caf1edfad4e9697da715af22456943: 2023-10-02 19:03:37,148 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 19:03:37,149 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696273417149"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696273417149"}]},"ts":"1696273417149"} 2023-10-02 19:03:37,149 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696273417149"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696273417149"}]},"ts":"1696273417149"} 2023-10-02 19:03:37,154 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-02 19:03:37,155 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 19:03:37,156 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696273417155"}]},"ts":"1696273417155"} 2023-10-02 19:03:37,157 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-10-02 19:03:37,159 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-10-02 19:03:37,160 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 19:03:37,160 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 19:03:37,160 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 19:03:37,160 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 19:03:37,160 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=53012b5690776af2ad146320d66230af, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=85caf1edfad4e9697da715af22456943, ASSIGN}] 2023-10-02 19:03:37,163 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=85caf1edfad4e9697da715af22456943, ASSIGN 2023-10-02 19:03:37,163 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=53012b5690776af2ad146320d66230af, ASSIGN 2023-10-02 19:03:37,164 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=53012b5690776af2ad146320d66230af, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34425,1696273349187; forceNewPlan=false, retain=false 2023-10-02 19:03:37,164 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=85caf1edfad4e9697da715af22456943, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38887,1696273349229; forceNewPlan=false, retain=false 2023-10-02 19:03:37,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-02 19:03:37,314 INFO [jenkins-hbase20:32777] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-02 19:03:37,316 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=85caf1edfad4e9697da715af22456943, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:37,316 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=53012b5690776af2ad146320d66230af, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:37,317 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696273417316"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696273417316"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696273417316"}]},"ts":"1696273417316"} 2023-10-02 19:03:37,317 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696273417316"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696273417316"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696273417316"}]},"ts":"1696273417316"} 2023-10-02 19:03:37,318 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 85caf1edfad4e9697da715af22456943, server=jenkins-hbase20.apache.org,38887,1696273349229}] 2023-10-02 19:03:37,319 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 53012b5690776af2ad146320d66230af, server=jenkins-hbase20.apache.org,34425,1696273349187}] 2023-10-02 19:03:37,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-02 19:03:37,484 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943. 2023-10-02 19:03:37,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 85caf1edfad4e9697da715af22456943, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943.', STARTKEY => '1', ENDKEY => ''} 2023-10-02 19:03:37,485 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af. 2023-10-02 19:03:37,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943. service=AccessControlService 2023-10-02 19:03:37,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 53012b5690776af2ad146320d66230af, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af.', STARTKEY => '', ENDKEY => '1'} 2023-10-02 19:03:37,485 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 19:03:37,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 85caf1edfad4e9697da715af22456943 2023-10-02 19:03:37,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af. service=AccessControlService 2023-10-02 19:03:37,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:03:37,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 85caf1edfad4e9697da715af22456943 2023-10-02 19:03:37,486 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 19:03:37,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 85caf1edfad4e9697da715af22456943 2023-10-02 19:03:37,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 53012b5690776af2ad146320d66230af 2023-10-02 19:03:37,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:03:37,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 53012b5690776af2ad146320d66230af 2023-10-02 19:03:37,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 53012b5690776af2ad146320d66230af 2023-10-02 19:03:37,488 INFO [StoreOpener-85caf1edfad4e9697da715af22456943-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 85caf1edfad4e9697da715af22456943 2023-10-02 19:03:37,488 INFO [StoreOpener-53012b5690776af2ad146320d66230af-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 53012b5690776af2ad146320d66230af 2023-10-02 19:03:37,492 DEBUG [StoreOpener-85caf1edfad4e9697da715af22456943-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion/85caf1edfad4e9697da715af22456943/cf 2023-10-02 19:03:37,492 DEBUG [StoreOpener-53012b5690776af2ad146320d66230af-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion/53012b5690776af2ad146320d66230af/cf 2023-10-02 19:03:37,492 DEBUG [StoreOpener-53012b5690776af2ad146320d66230af-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion/53012b5690776af2ad146320d66230af/cf 2023-10-02 19:03:37,492 DEBUG [StoreOpener-85caf1edfad4e9697da715af22456943-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion/85caf1edfad4e9697da715af22456943/cf 2023-10-02 19:03:37,493 INFO [StoreOpener-53012b5690776af2ad146320d66230af-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 53012b5690776af2ad146320d66230af columnFamilyName cf 2023-10-02 19:03:37,493 INFO [StoreOpener-85caf1edfad4e9697da715af22456943-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 85caf1edfad4e9697da715af22456943 columnFamilyName cf 2023-10-02 19:03:37,494 INFO [StoreOpener-53012b5690776af2ad146320d66230af-1] regionserver.HStore(310): Store=53012b5690776af2ad146320d66230af/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 19:03:37,494 INFO [StoreOpener-85caf1edfad4e9697da715af22456943-1] regionserver.HStore(310): Store=85caf1edfad4e9697da715af22456943/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 19:03:37,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion/53012b5690776af2ad146320d66230af 2023-10-02 19:03:37,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion/85caf1edfad4e9697da715af22456943 2023-10-02 19:03:37,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion/53012b5690776af2ad146320d66230af 2023-10-02 19:03:37,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion/85caf1edfad4e9697da715af22456943 2023-10-02 19:03:37,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 85caf1edfad4e9697da715af22456943 2023-10-02 19:03:37,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 53012b5690776af2ad146320d66230af 2023-10-02 19:03:37,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion/85caf1edfad4e9697da715af22456943/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 19:03:37,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion/53012b5690776af2ad146320d66230af/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 19:03:37,503 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 85caf1edfad4e9697da715af22456943; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74857189, jitterRate=0.11545903980731964}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 19:03:37,503 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 53012b5690776af2ad146320d66230af; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64884334, jitterRate=-0.03314808011054993}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 19:03:37,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 85caf1edfad4e9697da715af22456943: 2023-10-02 19:03:37,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 53012b5690776af2ad146320d66230af: 2023-10-02 19:03:37,505 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af., pid=61, masterSystemTime=1696273417472 2023-10-02 19:03:37,505 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943., pid=60, masterSystemTime=1696273417471 2023-10-02 19:03:37,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af. 2023-10-02 19:03:37,507 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af. 2023-10-02 19:03:37,507 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=53012b5690776af2ad146320d66230af, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:37,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943. 2023-10-02 19:03:37,507 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943. 2023-10-02 19:03:37,507 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696273417507"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696273417507"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696273417507"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696273417507"}]},"ts":"1696273417507"} 2023-10-02 19:03:37,508 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=85caf1edfad4e9697da715af22456943, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:37,508 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696273417508"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696273417508"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696273417508"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696273417508"}]},"ts":"1696273417508"} 2023-10-02 19:03:37,512 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-10-02 19:03:37,512 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 53012b5690776af2ad146320d66230af, server=jenkins-hbase20.apache.org,34425,1696273349187 in 190 msec 2023-10-02 19:03:37,513 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-10-02 19:03:37,513 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 85caf1edfad4e9697da715af22456943, server=jenkins-hbase20.apache.org,38887,1696273349229 in 193 msec 2023-10-02 19:03:37,513 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=53012b5690776af2ad146320d66230af, ASSIGN in 352 msec 2023-10-02 19:03:37,514 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-10-02 19:03:37,514 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=85caf1edfad4e9697da715af22456943, ASSIGN in 353 msec 2023-10-02 19:03:37,515 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 19:03:37,515 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696273417515"}]},"ts":"1696273417515"} 2023-10-02 19:03:37,517 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-10-02 19:03:37,519 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 19:03:37,519 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-10-02 19:03:37,521 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34425] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-02 19:03:37,522 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:03:37,522 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:03:37,522 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:03:37,522 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:03:37,523 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 19:03:37,523 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 19:03:37,523 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 19:03:37,523 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 19:03:37,524 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 412 msec 2023-10-02 19:03:37,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-02 19:03:37,722 INFO [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-10-02 19:03:37,727 DEBUG [Listener at jenkins-hbase20.apache.org/42825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,727 DEBUG [Listener at jenkins-hbase20.apache.org/42825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af. 2023-10-02 19:03:37,730 INFO [Listener at jenkins-hbase20.apache.org/42825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 19:03:37,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-02 19:03:37,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696273417748 (current time:1696273417748). 2023-10-02 19:03:37,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 19:03:37,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(139): Connect 0x151abeca to 127.0.0.1:60248 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 19:03:37,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@114c549e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 19:03:37,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:03:37,758 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47408, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:03:37,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x151abeca to 127.0.0.1:60248 2023-10-02 19:03:37,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:03:37,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(139): Connect 0x225db3be to 127.0.0.1:60248 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 19:03:37,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6271b5d1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 19:03:37,767 DEBUG [hconnection-0x11eae5a5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:03:37,768 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47420, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:03:37,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:03:37,774 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55640, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:03:37,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x225db3be to 127.0.0.1:60248 2023-10-02 19:03:37,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:03:37,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-02 19:03:37,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 19:03:37,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-02 19:03:37,780 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot, current working dir path: hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 19:03:37,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-02 19:03:37,783 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-02 19:03:37,784 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696274017784 2023-10-02 19:03:37,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-02 19:03:37,784 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,785 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 19:03:37,785 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 19:03:37,787 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-02 19:03:37,787 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-02 19:03:37,788 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-10-02 19:03:37,789 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-02 19:03:37,789 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696274017789 2023-10-02 19:03:37,798 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,798 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-02 19:03:37,798 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:03:37,799 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-02 19:03:37,799 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-02 19:03:37,800 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,800 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,800 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:37,800 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:37,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:37,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:37,800 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:37,800 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:37,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:37,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:37,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:37,801 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:37,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:37,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,801 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:37,801 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,801 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:37,801 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 19:03:37,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-02 19:03:37,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,802 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,802 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,802 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-02 19:03:37,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-02 19:03:37,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-02 19:03:37,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,802 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,802 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-02 19:03:37,802 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-02 19:03:37,802 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-02 19:03:37,802 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:03:37,802 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,803 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-02 19:03:37,803 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,804 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-02 19:03:37,804 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-02 19:03:37,804 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:03:37,804 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-02 19:03:37,804 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:03:37,805 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,32897,1696273349258' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-02 19:03:37,805 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-02 19:03:37,805 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-02 19:03:37,806 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38887,1696273349229' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-02 19:03:37,805 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-02 19:03:37,806 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-02 19:03:37,806 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34425,1696273349187' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-02 19:03:37,807 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,807 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:37,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:37,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:03:37,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:03:37,807 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,807 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,807 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:03:37,808 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:37,808 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,808 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,808 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:03:37,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:03:37,808 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,808 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:03:37,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:03:37,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:37,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:37,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:37,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:03:37,809 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38887,1696273349229' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-02 19:03:37,809 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c1d7dea[Count = 1] remaining members to acquire global barrier 2023-10-02 19:03:37,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:37,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:03:37,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:03:37,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:03:37,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:03:37,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:37,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:37,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:37,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:03:37,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34425,1696273349187' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-02 19:03:37,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c1d7dea[Count = 0] remaining members to acquire global barrier 2023-10-02 19:03:37,811 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-02 19:03:37,812 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,812 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,812 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,812 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,812 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:37,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,813 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-02 19:03:37,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,813 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-02 19:03:37,813 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-02 19:03:37,813 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 19:03:37,813 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af. 2023-10-02 19:03:37,813 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 19:03:37,813 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af. started... 2023-10-02 19:03:37,813 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-02 19:03:37,813 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943. 2023-10-02 19:03:37,813 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 19:03:37,813 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 53012b5690776af2ad146320d66230af: 2023-10-02 19:03:37,813 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:37,813 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 19:03:37,813 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 19:03:37,813 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943. started... 2023-10-02 19:03:37,813 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,32897,1696273349258' in zk 2023-10-02 19:03:37,813 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,815 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 85caf1edfad4e9697da715af22456943: 2023-10-02 19:03:37,815 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 19:03:37,815 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 19:03:37,815 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,815 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 19:03:37,815 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 19:03:37,817 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-02 19:03:37,817 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:03:37,817 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-02 19:03:37,825 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943. completed. 2023-10-02 19:03:37,826 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af. completed. 2023-10-02 19:03:37,826 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af. 2023-10-02 19:03:37,826 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943. 2023-10-02 19:03:37,826 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 19:03:37,826 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 19:03:37,826 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 19:03:37,826 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 19:03:37,826 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:37,826 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:37,826 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-02 19:03:37,826 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-02 19:03:37,826 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,34425,1696273349187' in zk 2023-10-02 19:03:37,826 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,38887,1696273349229' in zk 2023-10-02 19:03:37,838 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-02 19:03:37,838 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-02 19:03:37,838 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:03:37,838 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-02 19:03:37,838 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:37,838 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:03:37,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:37,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:03:37,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:03:37,840 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-02 19:03:37,840 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:37,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:03:37,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:03:37,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:37,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:37,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:37,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:03:37,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:37,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:37,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:37,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,34425,1696273349187': 2023-10-02 19:03:37,847 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34425,1696273349187' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-02 19:03:37,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:37,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:03:37,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:03:37,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:03:37,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:03:37,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:37,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:37,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:37,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:03:37,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:37,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:37,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:37,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,38887,1696273349229': 2023-10-02 19:03:37,851 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38887,1696273349229' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-02 19:03:37,851 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-02 19:03:37,851 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 19:03:37,851 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 19:03:37,851 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,851 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 19:03:37,852 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,852 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,852 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:37,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,852 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,852 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:03:37,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:03:37,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,852 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:37,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,852 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:37,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:03:37,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,852 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:37,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:37,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:37,853 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:37,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:37,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:37,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:37,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:37,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:03:37,853 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:37,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:37,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:37,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:37,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:03:37,854 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:37,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,855 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:37,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:37,855 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:37,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:37,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:37,863 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:37,863 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:37,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:37,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:37,863 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:03:37,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:37,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:37,863 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:37,863 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:37,863 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:37,863 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:37,866 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:37,863 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:37,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:37,866 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:37,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:37,866 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:37,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:37,866 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:37,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:37,866 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,866 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,866 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:37,866 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:37,866 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 19:03:37,866 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:37,867 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:37,867 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:37,867 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,867 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-02 19:03:37,873 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,873 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,886 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 19:03:37,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-02 19:03:37,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-02 19:03:37,887 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 19:03:37,891 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,892 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-02 19:03:37,892 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,892 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:37,892 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696273417784Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696273417873 (+89 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696273417873Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696273417873Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696273417876 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696273417886 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696273417892 (+6 ms) 2023-10-02 19:03:37,894 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-02 19:03:37,895 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 109 msec 2023-10-02 19:03:38,087 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 19:03:38,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-02 19:03:38,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 19:03:38,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34425] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 19:03:38,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38887] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 19:03:38,102 DEBUG [Listener at jenkins-hbase20.apache.org/42825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,102 DEBUG [Listener at jenkins-hbase20.apache.org/42825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af. 2023-10-02 19:03:38,102 INFO [Listener at jenkins-hbase20.apache.org/42825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 19:03:38,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-02 19:03:38,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696273418112 (current time:1696273418112). 2023-10-02 19:03:38,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 19:03:38,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(139): Connect 0x2da436c0 to 127.0.0.1:60248 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 19:03:38,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25aff04, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 19:03:38,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:03:38,122 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47432, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:03:38,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2da436c0 to 127.0.0.1:60248 2023-10-02 19:03:38,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:03:38,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(139): Connect 0x1c64b4e3 to 127.0.0.1:60248 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 19:03:38,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@107a8399, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 19:03:38,133 DEBUG [hconnection-0x458dec4d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:03:38,136 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47446, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:03:38,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:03:38,144 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55650, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:03:38,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c64b4e3 to 127.0.0.1:60248 2023-10-02 19:03:38,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:03:38,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-02 19:03:38,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 19:03:38,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-02 19:03:38,150 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot, current working dir path: hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 19:03:38,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-02 19:03:38,152 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-02 19:03:38,153 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696274018153 2023-10-02 19:03:38,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-02 19:03:38,153 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,155 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 19:03:38,155 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 19:03:38,156 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-02 19:03:38,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-02 19:03:38,157 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-10-02 19:03:38,158 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-02 19:03:38,159 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696274018159 2023-10-02 19:03:38,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,169 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-02 19:03:38,169 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:03:38,170 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-02 19:03:38,170 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-02 19:03:38,171 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,171 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,172 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:38,172 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:38,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:38,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:38,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:38,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:38,172 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:38,172 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:38,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:38,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:38,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,173 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:38,173 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:38,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,173 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,173 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,173 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,173 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:38,174 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 19:03:38,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-02 19:03:38,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-02 19:03:38,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-02 19:03:38,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,174 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-02 19:03:38,174 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-02 19:03:38,174 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-02 19:03:38,174 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,174 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,174 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-02 19:03:38,174 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-02 19:03:38,174 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:03:38,174 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:03:38,174 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,176 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-02 19:03:38,176 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-02 19:03:38,177 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:03:38,176 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-02 19:03:38,177 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-02 19:03:38,178 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-02 19:03:38,176 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-02 19:03:38,178 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,32897,1696273349258' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-02 19:03:38,178 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38887,1696273349229' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-02 19:03:38,177 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-02 19:03:38,178 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34425,1696273349187' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-02 19:03:38,182 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:38,182 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:38,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:03:38,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:03:38,182 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,182 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,182 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:38,182 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,182 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:03:38,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:03:38,183 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,183 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:03:38,183 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,183 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:03:38,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:03:38,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:38,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:38,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:38,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:03:38,185 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38887,1696273349229' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-02 19:03:38,185 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4640dd47[Count = 1] remaining members to acquire global barrier 2023-10-02 19:03:38,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:38,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:03:38,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:03:38,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:03:38,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:03:38,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:38,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:38,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:38,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:03:38,189 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34425,1696273349187' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-02 19:03:38,189 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4640dd47[Count = 0] remaining members to acquire global barrier 2023-10-02 19:03:38,189 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-02 19:03:38,189 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,190 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,190 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,190 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,191 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-02 19:03:38,191 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:38,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,191 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-02 19:03:38,191 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,32897,1696273349258' in zk 2023-10-02 19:03:38,191 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-02 19:03:38,192 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:38,192 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 19:03:38,191 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-02 19:03:38,192 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 19:03:38,192 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 19:03:38,192 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af. 2023-10-02 19:03:38,192 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943. 2023-10-02 19:03:38,192 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af. started... 2023-10-02 19:03:38,192 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943. started... 2023-10-02 19:03:38,192 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 19:03:38,192 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 19:03:38,192 INFO [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 53012b5690776af2ad146320d66230af 1/1 column families, dataSize=199 B heapSize=688 B 2023-10-02 19:03:38,192 INFO [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 85caf1edfad4e9697da715af22456943 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-10-02 19:03:38,193 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-02 19:03:38,193 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:03:38,193 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-02 19:03:38,221 INFO [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231002892adbf220e048c28d38bb8fe22f5cdb to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231002892adbf220e048c28d38bb8fe22f5cdb 2023-10-02 19:03:38,221 INFO [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310029cc733dddaa0402f99dd1cd7becd9d5e to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310029cc733dddaa0402f99dd1cd7becd9d5e 2023-10-02 19:03:38,230 INFO [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion/85caf1edfad4e9697da715af22456943/.tmp/cf/7fe375e99b7746a4a3913a9a8d6ed2ba 2023-10-02 19:03:38,230 INFO [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion/53012b5690776af2ad146320d66230af/.tmp/cf/255a9f8d38fe443191152395f6286bb4 2023-10-02 19:03:38,236 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion/53012b5690776af2ad146320d66230af/.tmp/cf/255a9f8d38fe443191152395f6286bb4 as hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion/53012b5690776af2ad146320d66230af/cf/255a9f8d38fe443191152395f6286bb4 2023-10-02 19:03:38,236 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion/85caf1edfad4e9697da715af22456943/.tmp/cf/7fe375e99b7746a4a3913a9a8d6ed2ba as hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion/85caf1edfad4e9697da715af22456943/cf/7fe375e99b7746a4a3913a9a8d6ed2ba 2023-10-02 19:03:38,240 INFO [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion/85caf1edfad4e9697da715af22456943/cf/7fe375e99b7746a4a3913a9a8d6ed2ba, entries=47, sequenceid=6, filesize=13.5 K 2023-10-02 19:03:38,240 INFO [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion/53012b5690776af2ad146320d66230af/cf/255a9f8d38fe443191152395f6286bb4, entries=3, sequenceid=6, filesize=5.4 K 2023-10-02 19:03:38,241 INFO [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 53012b5690776af2ad146320d66230af in 49ms, sequenceid=6, compaction requested=false 2023-10-02 19:03:38,241 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-10-02 19:03:38,242 INFO [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 85caf1edfad4e9697da715af22456943 in 50ms, sequenceid=6, compaction requested=false 2023-10-02 19:03:38,242 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-10-02 19:03:38,244 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 53012b5690776af2ad146320d66230af: 2023-10-02 19:03:38,244 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 85caf1edfad4e9697da715af22456943: 2023-10-02 19:03:38,244 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,244 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,244 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 19:03:38,244 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 19:03:38,244 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion/53012b5690776af2ad146320d66230af/cf/255a9f8d38fe443191152395f6286bb4] hfiles 2023-10-02 19:03:38,244 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion/85caf1edfad4e9697da715af22456943/cf/7fe375e99b7746a4a3913a9a8d6ed2ba] hfiles 2023-10-02 19:03:38,244 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion/53012b5690776af2ad146320d66230af/cf/255a9f8d38fe443191152395f6286bb4 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,244 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion/85caf1edfad4e9697da715af22456943/cf/7fe375e99b7746a4a3913a9a8d6ed2ba for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,252 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943. completed. 2023-10-02 19:03:38,252 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af. completed. 2023-10-02 19:03:38,252 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943. 2023-10-02 19:03:38,253 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af. 2023-10-02 19:03:38,253 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 19:03:38,253 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 19:03:38,253 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 19:03:38,253 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 19:03:38,253 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:38,253 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:38,253 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-02 19:03:38,253 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-02 19:03:38,253 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,38887,1696273349229' in zk 2023-10-02 19:03:38,253 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,34425,1696273349187' in zk 2023-10-02 19:03:38,254 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:38,254 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-02 19:03:38,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:38,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:03:38,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:03:38,254 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:03:38,254 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-02 19:03:38,255 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 19:03:38,255 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:38,255 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-02 19:03:38,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:03:38,256 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:03:38,256 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-02 19:03:38,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:03:38,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-02 19:03:38,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-02 19:03:38,257 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 19:03:38,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:38,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:38,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:38,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:03:38,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:38,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:38,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:38,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,38887,1696273349229': 2023-10-02 19:03:38,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38887,1696273349229' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-02 19:03:38,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:38,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:03:38,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:03:38,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:03:38,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:03:38,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:38,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:38,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:38,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:03:38,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:38,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:38,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:38,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,34425,1696273349187': 2023-10-02 19:03:38,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34425,1696273349187' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-02 19:03:38,263 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-02 19:03:38,263 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 19:03:38,263 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 19:03:38,263 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,263 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 19:03:38,266 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,266 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,266 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:38,266 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:38,266 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,266 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:38,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:38,266 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:38,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,266 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:38,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:03:38,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:03:38,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:38,267 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:38,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:38,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:38,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:38,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:03:38,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,267 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:38,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:03:38,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:38,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:38,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:38,269 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:38,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:03:38,269 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:38,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,270 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:38,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:38,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:38,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:38,272 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:38,272 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,272 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:38,272 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:38,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:38,272 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:38,272 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:38,273 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:38,272 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:38,273 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,273 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:38,273 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:03:38,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:38,273 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:38,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:38,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:38,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:38,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:38,273 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,273 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,275 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:38,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:38,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:38,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:38,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:38,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:38,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:38,275 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 19:03:38,276 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:38,276 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:38,276 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,276 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,276 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231002892adbf220e048c28d38bb8fe22f5cdb, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310029cc733dddaa0402f99dd1cd7becd9d5e] mob files 2023-10-02 19:03:38,277 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231002892adbf220e048c28d38bb8fe22f5cdb 2023-10-02 19:03:38,277 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310029cc733dddaa0402f99dd1cd7becd9d5e 2023-10-02 19:03:38,285 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,307 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,308 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-02 19:03:38,308 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,308 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:38,308 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696273418153Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696273418285 (+132 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696273418285Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1696273418285Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1696273418290 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696273418299 (+9 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696273418308 (+9 ms) 2023-10-02 19:03:38,311 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-02 19:03:38,312 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 157 msec 2023-10-02 19:03:38,458 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 19:03:38,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-02 19:03:38,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 19:03:38,489 DEBUG [Listener at jenkins-hbase20.apache.org/42825] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-02 19:03:38,493 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:32960, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-02 19:03:38,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32897] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-02 19:03:38,495 DEBUG [Listener at jenkins-hbase20.apache.org/42825] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-02 19:03:38,498 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55664, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-02 19:03:38,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34425] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-02 19:03:38,498 DEBUG [Listener at jenkins-hbase20.apache.org/42825] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-02 19:03:38,503 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47462, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-02 19:03:38,503 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38887] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-02 19:03:38,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-02 19:03:38,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:38,509 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 19:03:38,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-10-02 19:03:38,510 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 19:03:38,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-02 19:03:38,512 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/65459ab8c0b07e9ea98e8c866b7c618d 2023-10-02 19:03:38,512 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed7197cae28228c56510694f2e2a0c3d 2023-10-02 19:03:38,513 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/65459ab8c0b07e9ea98e8c866b7c618d empty. 2023-10-02 19:03:38,513 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed7197cae28228c56510694f2e2a0c3d empty. 2023-10-02 19:03:38,513 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/65459ab8c0b07e9ea98e8c866b7c618d 2023-10-02 19:03:38,513 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed7197cae28228c56510694f2e2a0c3d 2023-10-02 19:03:38,513 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-02 19:03:38,527 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-10-02 19:03:38,528 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 65459ab8c0b07e9ea98e8c866b7c618d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418505.65459ab8c0b07e9ea98e8c866b7c618d.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp 2023-10-02 19:03:38,530 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => ed7197cae28228c56510694f2e2a0c3d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696273418505.ed7197cae28228c56510694f2e2a0c3d.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp 2023-10-02 19:03:38,537 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696273418505.ed7197cae28228c56510694f2e2a0c3d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:03:38,537 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418505.65459ab8c0b07e9ea98e8c866b7c618d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:03:38,537 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing ed7197cae28228c56510694f2e2a0c3d, disabling compactions & flushes 2023-10-02 19:03:38,537 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 65459ab8c0b07e9ea98e8c866b7c618d, disabling compactions & flushes 2023-10-02 19:03:38,537 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696273418505.ed7197cae28228c56510694f2e2a0c3d. 2023-10-02 19:03:38,537 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418505.65459ab8c0b07e9ea98e8c866b7c618d. 2023-10-02 19:03:38,537 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696273418505.ed7197cae28228c56510694f2e2a0c3d. 2023-10-02 19:03:38,537 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418505.65459ab8c0b07e9ea98e8c866b7c618d. 2023-10-02 19:03:38,537 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696273418505.ed7197cae28228c56510694f2e2a0c3d. after waiting 0 ms 2023-10-02 19:03:38,537 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418505.65459ab8c0b07e9ea98e8c866b7c618d. after waiting 0 ms 2023-10-02 19:03:38,537 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696273418505.ed7197cae28228c56510694f2e2a0c3d. 2023-10-02 19:03:38,537 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418505.65459ab8c0b07e9ea98e8c866b7c618d. 2023-10-02 19:03:38,537 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696273418505.ed7197cae28228c56510694f2e2a0c3d. 2023-10-02 19:03:38,537 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418505.65459ab8c0b07e9ea98e8c866b7c618d. 2023-10-02 19:03:38,537 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for ed7197cae28228c56510694f2e2a0c3d: 2023-10-02 19:03:38,537 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 65459ab8c0b07e9ea98e8c866b7c618d: 2023-10-02 19:03:38,539 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 19:03:38,540 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696273418505.ed7197cae28228c56510694f2e2a0c3d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696273418540"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696273418540"}]},"ts":"1696273418540"} 2023-10-02 19:03:38,540 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418505.65459ab8c0b07e9ea98e8c866b7c618d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696273418540"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696273418540"}]},"ts":"1696273418540"} 2023-10-02 19:03:38,542 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-02 19:03:38,542 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 19:03:38,542 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696273418542"}]},"ts":"1696273418542"} 2023-10-02 19:03:38,543 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-10-02 19:03:38,546 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-10-02 19:03:38,547 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 19:03:38,547 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 19:03:38,547 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 19:03:38,547 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 19:03:38,547 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=65459ab8c0b07e9ea98e8c866b7c618d, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ed7197cae28228c56510694f2e2a0c3d, ASSIGN}] 2023-10-02 19:03:38,549 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ed7197cae28228c56510694f2e2a0c3d, ASSIGN 2023-10-02 19:03:38,550 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=65459ab8c0b07e9ea98e8c866b7c618d, ASSIGN 2023-10-02 19:03:38,550 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ed7197cae28228c56510694f2e2a0c3d, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38887,1696273349229; forceNewPlan=false, retain=false 2023-10-02 19:03:38,550 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=65459ab8c0b07e9ea98e8c866b7c618d, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,32897,1696273349258; forceNewPlan=false, retain=false 2023-10-02 19:03:38,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-02 19:03:38,701 INFO [jenkins-hbase20:32777] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-02 19:03:38,705 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=ed7197cae28228c56510694f2e2a0c3d, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:38,705 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=65459ab8c0b07e9ea98e8c866b7c618d, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:38,706 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696273418505.ed7197cae28228c56510694f2e2a0c3d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696273418705"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696273418705"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696273418705"}]},"ts":"1696273418705"} 2023-10-02 19:03:38,706 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418505.65459ab8c0b07e9ea98e8c866b7c618d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696273418705"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696273418705"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696273418705"}]},"ts":"1696273418705"} 2023-10-02 19:03:38,709 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure ed7197cae28228c56510694f2e2a0c3d, server=jenkins-hbase20.apache.org,38887,1696273349229}] 2023-10-02 19:03:38,711 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 65459ab8c0b07e9ea98e8c866b7c618d, server=jenkins-hbase20.apache.org,32897,1696273349258}] 2023-10-02 19:03:38,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-02 19:03:38,877 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418505.65459ab8c0b07e9ea98e8c866b7c618d. 2023-10-02 19:03:38,877 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1696273418505.ed7197cae28228c56510694f2e2a0c3d. 2023-10-02 19:03:38,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 65459ab8c0b07e9ea98e8c866b7c618d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418505.65459ab8c0b07e9ea98e8c866b7c618d.', STARTKEY => '', ENDKEY => '2'} 2023-10-02 19:03:38,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ed7197cae28228c56510694f2e2a0c3d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696273418505.ed7197cae28228c56510694f2e2a0c3d.', STARTKEY => '2', ENDKEY => ''} 2023-10-02 19:03:38,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1696273418505.ed7197cae28228c56510694f2e2a0c3d. service=AccessControlService 2023-10-02 19:03:38,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418505.65459ab8c0b07e9ea98e8c866b7c618d. service=AccessControlService 2023-10-02 19:03:38,878 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 19:03:38,878 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 19:03:38,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 ed7197cae28228c56510694f2e2a0c3d 2023-10-02 19:03:38,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 65459ab8c0b07e9ea98e8c866b7c618d 2023-10-02 19:03:38,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696273418505.ed7197cae28228c56510694f2e2a0c3d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:03:38,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418505.65459ab8c0b07e9ea98e8c866b7c618d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:03:38,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for ed7197cae28228c56510694f2e2a0c3d 2023-10-02 19:03:38,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 65459ab8c0b07e9ea98e8c866b7c618d 2023-10-02 19:03:38,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for ed7197cae28228c56510694f2e2a0c3d 2023-10-02 19:03:38,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 65459ab8c0b07e9ea98e8c866b7c618d 2023-10-02 19:03:38,879 INFO [StoreOpener-ed7197cae28228c56510694f2e2a0c3d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ed7197cae28228c56510694f2e2a0c3d 2023-10-02 19:03:38,879 INFO [StoreOpener-65459ab8c0b07e9ea98e8c866b7c618d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 65459ab8c0b07e9ea98e8c866b7c618d 2023-10-02 19:03:38,880 DEBUG [StoreOpener-65459ab8c0b07e9ea98e8c866b7c618d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/65459ab8c0b07e9ea98e8c866b7c618d/cf 2023-10-02 19:03:38,880 DEBUG [StoreOpener-ed7197cae28228c56510694f2e2a0c3d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed7197cae28228c56510694f2e2a0c3d/cf 2023-10-02 19:03:38,880 DEBUG [StoreOpener-65459ab8c0b07e9ea98e8c866b7c618d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/65459ab8c0b07e9ea98e8c866b7c618d/cf 2023-10-02 19:03:38,880 DEBUG [StoreOpener-ed7197cae28228c56510694f2e2a0c3d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed7197cae28228c56510694f2e2a0c3d/cf 2023-10-02 19:03:38,881 INFO [StoreOpener-65459ab8c0b07e9ea98e8c866b7c618d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 65459ab8c0b07e9ea98e8c866b7c618d columnFamilyName cf 2023-10-02 19:03:38,881 INFO [StoreOpener-ed7197cae28228c56510694f2e2a0c3d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ed7197cae28228c56510694f2e2a0c3d columnFamilyName cf 2023-10-02 19:03:38,881 INFO [StoreOpener-ed7197cae28228c56510694f2e2a0c3d-1] regionserver.HStore(310): Store=ed7197cae28228c56510694f2e2a0c3d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 19:03:38,881 INFO [StoreOpener-65459ab8c0b07e9ea98e8c866b7c618d-1] regionserver.HStore(310): Store=65459ab8c0b07e9ea98e8c866b7c618d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 19:03:38,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/65459ab8c0b07e9ea98e8c866b7c618d 2023-10-02 19:03:38,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed7197cae28228c56510694f2e2a0c3d 2023-10-02 19:03:38,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/65459ab8c0b07e9ea98e8c866b7c618d 2023-10-02 19:03:38,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed7197cae28228c56510694f2e2a0c3d 2023-10-02 19:03:38,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 65459ab8c0b07e9ea98e8c866b7c618d 2023-10-02 19:03:38,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for ed7197cae28228c56510694f2e2a0c3d 2023-10-02 19:03:38,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/65459ab8c0b07e9ea98e8c866b7c618d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 19:03:38,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed7197cae28228c56510694f2e2a0c3d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 19:03:38,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 65459ab8c0b07e9ea98e8c866b7c618d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69767831, jitterRate=0.03962169587612152}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 19:03:38,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened ed7197cae28228c56510694f2e2a0c3d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60662558, jitterRate=-0.09605744481086731}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 19:03:38,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 65459ab8c0b07e9ea98e8c866b7c618d: 2023-10-02 19:03:38,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for ed7197cae28228c56510694f2e2a0c3d: 2023-10-02 19:03:38,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696273418505.ed7197cae28228c56510694f2e2a0c3d., pid=69, masterSystemTime=1696273418862 2023-10-02 19:03:38,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418505.65459ab8c0b07e9ea98e8c866b7c618d., pid=70, masterSystemTime=1696273418863 2023-10-02 19:03:38,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696273418505.ed7197cae28228c56510694f2e2a0c3d. 2023-10-02 19:03:38,889 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1696273418505.ed7197cae28228c56510694f2e2a0c3d. 2023-10-02 19:03:38,890 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=ed7197cae28228c56510694f2e2a0c3d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:38,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418505.65459ab8c0b07e9ea98e8c866b7c618d. 2023-10-02 19:03:38,890 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696273418505.ed7197cae28228c56510694f2e2a0c3d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696273418890"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696273418890"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696273418890"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696273418890"}]},"ts":"1696273418890"} 2023-10-02 19:03:38,890 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418505.65459ab8c0b07e9ea98e8c866b7c618d. 2023-10-02 19:03:38,890 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=65459ab8c0b07e9ea98e8c866b7c618d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:38,890 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418505.65459ab8c0b07e9ea98e8c866b7c618d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696273418890"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696273418890"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696273418890"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696273418890"}]},"ts":"1696273418890"} 2023-10-02 19:03:38,893 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=68 2023-10-02 19:03:38,893 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure ed7197cae28228c56510694f2e2a0c3d, server=jenkins-hbase20.apache.org,38887,1696273349229 in 182 msec 2023-10-02 19:03:38,893 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=67 2023-10-02 19:03:38,894 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 65459ab8c0b07e9ea98e8c866b7c618d, server=jenkins-hbase20.apache.org,32897,1696273349258 in 181 msec 2023-10-02 19:03:38,894 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ed7197cae28228c56510694f2e2a0c3d, ASSIGN in 346 msec 2023-10-02 19:03:38,895 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-10-02 19:03:38,895 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=65459ab8c0b07e9ea98e8c866b7c618d, ASSIGN in 347 msec 2023-10-02 19:03:38,896 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 19:03:38,896 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696273418896"}]},"ts":"1696273418896"} 2023-10-02 19:03:38,897 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-10-02 19:03:38,898 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 19:03:38,899 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-10-02 19:03:38,900 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34425] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-02 19:03:38,901 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:03:38,901 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:03:38,901 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:03:38,901 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:03:38,902 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 19:03:38,902 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 19:03:38,902 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 19:03:38,902 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-02 19:03:38,903 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-02 19:03:38,903 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-02 19:03:38,902 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 19:03:38,903 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-02 19:03:38,903 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 396 msec 2023-10-02 19:03:39,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-02 19:03:39,119 INFO [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-10-02 19:03:39,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.HMaster$2(1952): Client=jenkins//148.251.75.209 merge regions 65459ab8c0b07e9ea98e8c866b7c618d, ed7197cae28228c56510694f2e2a0c3d 2023-10-02 19:03:39,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[65459ab8c0b07e9ea98e8c866b7c618d, ed7197cae28228c56510694f2e2a0c3d], force=true 2023-10-02 19:03:39,159 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[65459ab8c0b07e9ea98e8c866b7c618d, ed7197cae28228c56510694f2e2a0c3d], force=true 2023-10-02 19:03:39,159 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[65459ab8c0b07e9ea98e8c866b7c618d, ed7197cae28228c56510694f2e2a0c3d], force=true 2023-10-02 19:03:39,159 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[65459ab8c0b07e9ea98e8c866b7c618d, ed7197cae28228c56510694f2e2a0c3d], force=true 2023-10-02 19:03:39,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-02 19:03:39,182 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=65459ab8c0b07e9ea98e8c866b7c618d, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ed7197cae28228c56510694f2e2a0c3d, UNASSIGN}] 2023-10-02 19:03:39,184 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=65459ab8c0b07e9ea98e8c866b7c618d, UNASSIGN 2023-10-02 19:03:39,185 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ed7197cae28228c56510694f2e2a0c3d, UNASSIGN 2023-10-02 19:03:39,186 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=65459ab8c0b07e9ea98e8c866b7c618d, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:39,186 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=ed7197cae28228c56510694f2e2a0c3d, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:39,186 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418505.65459ab8c0b07e9ea98e8c866b7c618d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696273419185"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696273419185"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696273419185"}]},"ts":"1696273419185"} 2023-10-02 19:03:39,186 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696273418505.ed7197cae28228c56510694f2e2a0c3d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696273419185"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696273419185"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696273419185"}]},"ts":"1696273419185"} 2023-10-02 19:03:39,187 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 65459ab8c0b07e9ea98e8c866b7c618d, server=jenkins-hbase20.apache.org,32897,1696273349258}] 2023-10-02 19:03:39,188 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure ed7197cae28228c56510694f2e2a0c3d, server=jenkins-hbase20.apache.org,38887,1696273349229}] 2023-10-02 19:03:39,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-02 19:03:39,339 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 65459ab8c0b07e9ea98e8c866b7c618d 2023-10-02 19:03:39,339 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close ed7197cae28228c56510694f2e2a0c3d 2023-10-02 19:03:39,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 65459ab8c0b07e9ea98e8c866b7c618d, disabling compactions & flushes 2023-10-02 19:03:39,341 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418505.65459ab8c0b07e9ea98e8c866b7c618d. 2023-10-02 19:03:39,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418505.65459ab8c0b07e9ea98e8c866b7c618d. 2023-10-02 19:03:39,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418505.65459ab8c0b07e9ea98e8c866b7c618d. after waiting 0 ms 2023-10-02 19:03:39,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418505.65459ab8c0b07e9ea98e8c866b7c618d. 2023-10-02 19:03:39,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing ed7197cae28228c56510694f2e2a0c3d, disabling compactions & flushes 2023-10-02 19:03:39,341 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 65459ab8c0b07e9ea98e8c866b7c618d 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-02 19:03:39,341 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696273418505.ed7197cae28228c56510694f2e2a0c3d. 2023-10-02 19:03:39,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696273418505.ed7197cae28228c56510694f2e2a0c3d. 2023-10-02 19:03:39,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696273418505.ed7197cae28228c56510694f2e2a0c3d. after waiting 0 ms 2023-10-02 19:03:39,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696273418505.ed7197cae28228c56510694f2e2a0c3d. 2023-10-02 19:03:39,341 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing ed7197cae28228c56510694f2e2a0c3d 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-02 19:03:39,350 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed7197cae28228c56510694f2e2a0c3d/.tmp/cf/e6dde241f91a4cfe8a8510e0883c0df1 2023-10-02 19:03:39,353 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/65459ab8c0b07e9ea98e8c866b7c618d/.tmp/cf/dfe21f8990e94172b059eb56429a15e5 2023-10-02 19:03:39,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed7197cae28228c56510694f2e2a0c3d/.tmp/cf/e6dde241f91a4cfe8a8510e0883c0df1 as hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed7197cae28228c56510694f2e2a0c3d/cf/e6dde241f91a4cfe8a8510e0883c0df1 2023-10-02 19:03:39,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/65459ab8c0b07e9ea98e8c866b7c618d/.tmp/cf/dfe21f8990e94172b059eb56429a15e5 as hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/65459ab8c0b07e9ea98e8c866b7c618d/cf/dfe21f8990e94172b059eb56429a15e5 2023-10-02 19:03:39,361 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed7197cae28228c56510694f2e2a0c3d/cf/e6dde241f91a4cfe8a8510e0883c0df1, entries=1, sequenceid=5, filesize=4.7 K 2023-10-02 19:03:39,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for ed7197cae28228c56510694f2e2a0c3d in 21ms, sequenceid=5, compaction requested=false 2023-10-02 19:03:39,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-10-02 19:03:39,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/65459ab8c0b07e9ea98e8c866b7c618d/cf/dfe21f8990e94172b059eb56429a15e5, entries=1, sequenceid=5, filesize=4.7 K 2023-10-02 19:03:39,366 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 65459ab8c0b07e9ea98e8c866b7c618d in 25ms, sequenceid=5, compaction requested=false 2023-10-02 19:03:39,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed7197cae28228c56510694f2e2a0c3d/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-02 19:03:39,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/65459ab8c0b07e9ea98e8c866b7c618d/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-02 19:03:39,373 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 19:03:39,373 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 19:03:39,373 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696273418505.ed7197cae28228c56510694f2e2a0c3d. 2023-10-02 19:03:39,373 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418505.65459ab8c0b07e9ea98e8c866b7c618d. 2023-10-02 19:03:39,373 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for ed7197cae28228c56510694f2e2a0c3d: 2023-10-02 19:03:39,373 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 65459ab8c0b07e9ea98e8c866b7c618d: 2023-10-02 19:03:39,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 65459ab8c0b07e9ea98e8c866b7c618d 2023-10-02 19:03:39,375 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=65459ab8c0b07e9ea98e8c866b7c618d, regionState=CLOSED 2023-10-02 19:03:39,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed ed7197cae28228c56510694f2e2a0c3d 2023-10-02 19:03:39,375 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418505.65459ab8c0b07e9ea98e8c866b7c618d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696273419375"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696273419375"}]},"ts":"1696273419375"} 2023-10-02 19:03:39,375 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=ed7197cae28228c56510694f2e2a0c3d, regionState=CLOSED 2023-10-02 19:03:39,375 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696273418505.ed7197cae28228c56510694f2e2a0c3d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696273419375"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696273419375"}]},"ts":"1696273419375"} 2023-10-02 19:03:39,377 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-10-02 19:03:39,378 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 65459ab8c0b07e9ea98e8c866b7c618d, server=jenkins-hbase20.apache.org,32897,1696273349258 in 189 msec 2023-10-02 19:03:39,378 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-10-02 19:03:39,378 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure ed7197cae28228c56510694f2e2a0c3d, server=jenkins-hbase20.apache.org,38887,1696273349229 in 189 msec 2023-10-02 19:03:39,379 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=65459ab8c0b07e9ea98e8c866b7c618d, UNASSIGN in 201 msec 2023-10-02 19:03:39,380 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=71 2023-10-02 19:03:39,380 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ed7197cae28228c56510694f2e2a0c3d, UNASSIGN in 196 msec 2023-10-02 19:03:39,428 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a897c4858188ad5e961aa6478f36ec28/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-10-02 19:03:39,430 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418505.65459ab8c0b07e9ea98e8c866b7c618d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-02 19:03:39,430 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696273418505.ed7197cae28228c56510694f2e2a0c3d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-02 19:03:39,430 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418506.a897c4858188ad5e961aa6478f36ec28.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-02 19:03:39,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-02 19:03:39,471 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a897c4858188ad5e961aa6478f36ec28, ASSIGN}] 2023-10-02 19:03:39,472 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a897c4858188ad5e961aa6478f36ec28, ASSIGN 2023-10-02 19:03:39,473 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a897c4858188ad5e961aa6478f36ec28, ASSIGN; state=MERGED, location=jenkins-hbase20.apache.org,32897,1696273349258; forceNewPlan=false, retain=false 2023-10-02 19:03:39,623 INFO [jenkins-hbase20:32777] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-02 19:03:39,627 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=a897c4858188ad5e961aa6478f36ec28, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:39,628 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418506.a897c4858188ad5e961aa6478f36ec28.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696273419627"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696273419627"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696273419627"}]},"ts":"1696273419627"} 2023-10-02 19:03:39,632 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure a897c4858188ad5e961aa6478f36ec28, server=jenkins-hbase20.apache.org,32897,1696273349258}] 2023-10-02 19:03:39,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-02 19:03:39,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418506.a897c4858188ad5e961aa6478f36ec28. 2023-10-02 19:03:39,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a897c4858188ad5e961aa6478f36ec28, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418506.a897c4858188ad5e961aa6478f36ec28.', STARTKEY => '', ENDKEY => ''} 2023-10-02 19:03:39,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418506.a897c4858188ad5e961aa6478f36ec28. service=AccessControlService 2023-10-02 19:03:39,795 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 19:03:39,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 a897c4858188ad5e961aa6478f36ec28 2023-10-02 19:03:39,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418506.a897c4858188ad5e961aa6478f36ec28.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:03:39,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for a897c4858188ad5e961aa6478f36ec28 2023-10-02 19:03:39,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for a897c4858188ad5e961aa6478f36ec28 2023-10-02 19:03:39,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a897c4858188ad5e961aa6478f36ec28/.regioninfo 2023-10-02 19:03:39,810 INFO [StoreOpener-a897c4858188ad5e961aa6478f36ec28-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a897c4858188ad5e961aa6478f36ec28 2023-10-02 19:03:39,811 DEBUG [StoreOpener-a897c4858188ad5e961aa6478f36ec28-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a897c4858188ad5e961aa6478f36ec28/cf 2023-10-02 19:03:39,811 DEBUG [StoreOpener-a897c4858188ad5e961aa6478f36ec28-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a897c4858188ad5e961aa6478f36ec28/cf 2023-10-02 19:03:39,811 INFO [StoreOpener-a897c4858188ad5e961aa6478f36ec28-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a897c4858188ad5e961aa6478f36ec28 columnFamilyName cf 2023-10-02 19:03:39,836 DEBUG [StoreOpener-a897c4858188ad5e961aa6478f36ec28-1] regionserver.HStore(539): loaded hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a897c4858188ad5e961aa6478f36ec28/cf/dfe21f8990e94172b059eb56429a15e5.65459ab8c0b07e9ea98e8c866b7c618d->hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/65459ab8c0b07e9ea98e8c866b7c618d/cf/dfe21f8990e94172b059eb56429a15e5-top 2023-10-02 19:03:39,841 DEBUG [StoreOpener-a897c4858188ad5e961aa6478f36ec28-1] regionserver.HStore(539): loaded hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a897c4858188ad5e961aa6478f36ec28/cf/e6dde241f91a4cfe8a8510e0883c0df1.ed7197cae28228c56510694f2e2a0c3d->hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed7197cae28228c56510694f2e2a0c3d/cf/e6dde241f91a4cfe8a8510e0883c0df1-top 2023-10-02 19:03:39,842 INFO [StoreOpener-a897c4858188ad5e961aa6478f36ec28-1] regionserver.HStore(310): Store=a897c4858188ad5e961aa6478f36ec28/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 19:03:39,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a897c4858188ad5e961aa6478f36ec28 2023-10-02 19:03:39,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a897c4858188ad5e961aa6478f36ec28 2023-10-02 19:03:39,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for a897c4858188ad5e961aa6478f36ec28 2023-10-02 19:03:39,847 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened a897c4858188ad5e961aa6478f36ec28; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74531589, jitterRate=0.11060722172260284}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 19:03:39,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for a897c4858188ad5e961aa6478f36ec28: 2023-10-02 19:03:39,848 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418506.a897c4858188ad5e961aa6478f36ec28., pid=77, masterSystemTime=1696273419786 2023-10-02 19:03:39,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418506.a897c4858188ad5e961aa6478f36ec28.,because compaction is disabled. 2023-10-02 19:03:39,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418506.a897c4858188ad5e961aa6478f36ec28. 2023-10-02 19:03:39,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418506.a897c4858188ad5e961aa6478f36ec28. 2023-10-02 19:03:39,850 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=a897c4858188ad5e961aa6478f36ec28, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:39,851 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418506.a897c4858188ad5e961aa6478f36ec28.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696273419850"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696273419850"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696273419850"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696273419850"}]},"ts":"1696273419850"} 2023-10-02 19:03:39,854 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-10-02 19:03:39,854 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure a897c4858188ad5e961aa6478f36ec28, server=jenkins-hbase20.apache.org,32897,1696273349258 in 220 msec 2023-10-02 19:03:39,856 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-10-02 19:03:39,856 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a897c4858188ad5e961aa6478f36ec28, ASSIGN in 383 msec 2023-10-02 19:03:39,857 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[65459ab8c0b07e9ea98e8c866b7c618d, ed7197cae28228c56510694f2e2a0c3d], force=true in 704 msec 2023-10-02 19:03:40,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-02 19:03:40,270 INFO [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-10-02 19:03:40,273 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-02 19:03:40,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696273420273 (current time:1696273420273). 2023-10-02 19:03:40,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 19:03:40,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(139): Connect 0x05f12985 to 127.0.0.1:60248 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 19:03:40,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76c2e46a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 19:03:40,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:03:40,287 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47474, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:03:40,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x05f12985 to 127.0.0.1:60248 2023-10-02 19:03:40,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:03:40,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(139): Connect 0x76258bbe to 127.0.0.1:60248 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 19:03:40,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a1439fe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 19:03:40,301 DEBUG [hconnection-0x1b947362-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:03:40,304 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47476, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:03:40,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:03:40,311 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55674, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:03:40,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x76258bbe to 127.0.0.1:60248 2023-10-02 19:03:40,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:03:40,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-02 19:03:40,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 19:03:40,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-02 19:03:40,316 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot, current working dir path: hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 19:03:40,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-02 19:03:40,319 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-02 19:03:40,320 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1696274020320 2023-10-02 19:03:40,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-02 19:03:40,320 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,323 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 19:03:40,323 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 19:03:40,324 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-02 19:03:40,325 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-02 19:03:40,326 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 8 msec 2023-10-02 19:03:40,327 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-02 19:03:40,328 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1696274020328 2023-10-02 19:03:40,336 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,336 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-10-02 19:03:40,336 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:03:40,337 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-10-02 19:03:40,337 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-10-02 19:03:40,338 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,338 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,339 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:40,339 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:40,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:40,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:40,339 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:40,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:40,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:40,339 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:40,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:40,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:40,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,339 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:40,339 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,339 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 19:03:40,340 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-02 19:03:40,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,340 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,340 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-02 19:03:40,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-02 19:03:40,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-02 19:03:40,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,340 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,340 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-02 19:03:40,340 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-02 19:03:40,340 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:03:40,340 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-02 19:03:40,340 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,342 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-02 19:03:40,342 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-02 19:03:40,342 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:03:40,342 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-02 19:03:40,342 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38887,1696273349229' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-02 19:03:40,343 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,344 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,344 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-02 19:03:40,344 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:03:40,344 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-02 19:03:40,345 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-02 19:03:40,345 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-02 19:03:40,345 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34425,1696273349187' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-02 19:03:40,345 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-02 19:03:40,345 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,32897,1696273349258' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-02 19:03:40,345 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,345 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:03:40,346 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,347 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,347 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:40,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:40,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:03:40,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:03:40,347 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,347 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:03:40,347 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,347 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:03:40,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:03:40,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:03:40,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:40,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:40,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:40,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:03:40,350 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,32897,1696273349258' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-10-02 19:03:40,350 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3155bb39[Count = 0] remaining members to acquire global barrier 2023-10-02 19:03:40,350 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-10-02 19:03:40,350 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,351 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,351 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,351 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,351 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-02 19:03:40,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,351 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:40,351 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 19:03:40,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,351 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-02 19:03:40,352 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-02 19:03:40,351 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-02 19:03:40,352 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-02 19:03:40,352 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase20.apache.org,38887,1696273349229' in zk 2023-10-02 19:03:40,352 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase20.apache.org,34425,1696273349187' in zk 2023-10-02 19:03:40,352 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 19:03:40,352 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418506.a897c4858188ad5e961aa6478f36ec28. 2023-10-02 19:03:40,352 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 19:03:40,352 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418506.a897c4858188ad5e961aa6478f36ec28. started... 2023-10-02 19:03:40,354 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a897c4858188ad5e961aa6478f36ec28: 2023-10-02 19:03:40,354 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418506.a897c4858188ad5e961aa6478f36ec28.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,354 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 19:03:40,354 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a897c4858188ad5e961aa6478f36ec28/cf/dfe21f8990e94172b059eb56429a15e5.65459ab8c0b07e9ea98e8c866b7c618d->hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/65459ab8c0b07e9ea98e8c866b7c618d/cf/dfe21f8990e94172b059eb56429a15e5-top, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a897c4858188ad5e961aa6478f36ec28/cf/e6dde241f91a4cfe8a8510e0883c0df1.ed7197cae28228c56510694f2e2a0c3d->hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed7197cae28228c56510694f2e2a0c3d/cf/e6dde241f91a4cfe8a8510e0883c0df1-top] hfiles 2023-10-02 19:03:40,354 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a897c4858188ad5e961aa6478f36ec28/cf/dfe21f8990e94172b059eb56429a15e5.65459ab8c0b07e9ea98e8c866b7c618d for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,354 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-02 19:03:40,354 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:03:40,355 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-02 19:03:40,356 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-02 19:03:40,356 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:03:40,356 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-02 19:03:40,359 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a897c4858188ad5e961aa6478f36ec28/cf/e6dde241f91a4cfe8a8510e0883c0df1.ed7197cae28228c56510694f2e2a0c3d for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,365 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418506.a897c4858188ad5e961aa6478f36ec28. completed. 2023-10-02 19:03:40,365 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418506.a897c4858188ad5e961aa6478f36ec28. 2023-10-02 19:03:40,366 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 19:03:40,366 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 19:03:40,366 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:40,366 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-02 19:03:40,366 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase20.apache.org,32897,1696273349258' in zk 2023-10-02 19:03:40,368 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-02 19:03:40,368 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:40,368 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:03:40,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:40,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:03:40,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:03:40,368 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-02 19:03:40,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:03:40,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:03:40,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:40,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:40,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:40,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:03:40,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:40,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:40,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:40,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase20.apache.org,32897,1696273349258': 2023-10-02 19:03:40,372 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,32897,1696273349258' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-10-02 19:03:40,372 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-10-02 19:03:40,372 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 19:03:40,372 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 19:03:40,372 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,372 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 19:03:40,380 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,380 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,380 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,380 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,380 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:40,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:03:40,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:03:40,380 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:40,381 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:40,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,380 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:40,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:40,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:40,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:40,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:40,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:40,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:03:40,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:40,381 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:40,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,386 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:40,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:03:40,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:40,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:40,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:40,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:03:40,389 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:40,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,389 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:40,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:40,390 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:40,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:40,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:40,393 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:40,393 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,393 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:40,393 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:40,393 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:40,393 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:40,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:40,394 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:40,394 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:40,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:40,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:40,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:40,394 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:03:40,394 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:40,394 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:40,394 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:40,394 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:40,394 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,394 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:40,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:40,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:40,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:40,394 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:40,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:40,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:40,394 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:40,394 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:40,395 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,395 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,411 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,412 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-10-02 19:03:40,412 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,412 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,412 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1696273420320Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696273420394 (+74 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696273420394Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696273420397 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696273420405 (+8 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1696273420412 (+7 ms) 2023-10-02 19:03:40,414 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-02 19:03:40,415 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 91 msec 2023-10-02 19:03:40,424 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 19:03:40,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-10-02 19:03:40,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 19:03:40,425 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273420425 2023-10-02 19:03:40,425 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46307, tgtDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273420425, rawTgtDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273420425, srcFsUri=hdfs://localhost:46307, srcDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6 2023-10-02 19:03:40,442 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46307, inputRoot=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6 2023-10-02 19:03:40,443 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_60876618_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273420425, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273420425/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,443 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46307, inputRoot=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6, snapshotDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-10-02 19:03:40,451 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273420425/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:40,469 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:40,470 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:40,470 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:40,470 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:40,851 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696273355352_0004_000001 (auth:SIMPLE) 2023-10-02 19:03:41,186 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/hadoop-6904311155897807646.jar 2023-10-02 19:03:41,187 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:41,187 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:41,240 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/hadoop-77674700907653167.jar 2023-10-02 19:03:41,240 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:41,240 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:41,240 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:41,241 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:41,241 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:41,241 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:41,242 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-02 19:03:41,242 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-02 19:03:41,242 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-02 19:03:41,243 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-02 19:03:41,243 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-02 19:03:41,243 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-02 19:03:41,243 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-02 19:03:41,244 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-02 19:03:41,244 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-02 19:03:41,244 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-02 19:03:41,245 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 19:03:41,245 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 19:03:41,245 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 19:03:41,246 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 19:03:41,246 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 19:03:41,246 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 19:03:41,247 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 19:03:41,586 WARN [Listener at jenkins-hbase20.apache.org/42825] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-02 19:03:41,588 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-10-02 19:03:41,590 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-10-02 19:03:41,676 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 19:03:41,676 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 19:03:41,853 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696273355352_0005_000001 (auth:SIMPLE) 2023-10-02 19:03:42,388 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-02 19:03:45,120 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696273355352_0005_000001 (auth:SIMPLE) 2023-10-02 19:03:47,328 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696273355352_0005_000001 (auth:SIMPLE) 2023-10-02 19:03:49,893 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696273355352_0005_000001 (auth:SIMPLE) 2023-10-02 19:03:51,801 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-02 19:03:51,803 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-02 19:03:51,810 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:51,810 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-02 19:03:51,811 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-02 19:03:51,811 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1557508828_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:51,812 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(367): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-02 19:03:51,812 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(367): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-02 19:03:51,812 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1557508828_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273420425/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273420425/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:51,812 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(367): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273420425/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-02 19:03:51,812 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(367): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273420425/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-02 19:03:51,817 INFO [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:51,818 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:51,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:51,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-02 19:03:51,821 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696273431821"}]},"ts":"1696273431821"} 2023-10-02 19:03:51,822 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-10-02 19:03:51,824 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-10-02 19:03:51,824 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a897c4858188ad5e961aa6478f36ec28, UNASSIGN}] 2023-10-02 19:03:51,825 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a897c4858188ad5e961aa6478f36ec28, UNASSIGN 2023-10-02 19:03:51,826 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=a897c4858188ad5e961aa6478f36ec28, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:51,826 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418506.a897c4858188ad5e961aa6478f36ec28.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696273431826"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696273431826"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696273431826"}]},"ts":"1696273431826"} 2023-10-02 19:03:51,827 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure a897c4858188ad5e961aa6478f36ec28, server=jenkins-hbase20.apache.org,32897,1696273349258}] 2023-10-02 19:03:51,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-02 19:03:51,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close a897c4858188ad5e961aa6478f36ec28 2023-10-02 19:03:51,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing a897c4858188ad5e961aa6478f36ec28, disabling compactions & flushes 2023-10-02 19:03:51,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418506.a897c4858188ad5e961aa6478f36ec28. 2023-10-02 19:03:51,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418506.a897c4858188ad5e961aa6478f36ec28. 2023-10-02 19:03:51,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418506.a897c4858188ad5e961aa6478f36ec28. after waiting 0 ms 2023-10-02 19:03:51,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418506.a897c4858188ad5e961aa6478f36ec28. 2023-10-02 19:03:51,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a897c4858188ad5e961aa6478f36ec28/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-10-02 19:03:51,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 19:03:51,997 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418506.a897c4858188ad5e961aa6478f36ec28. 2023-10-02 19:03:51,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for a897c4858188ad5e961aa6478f36ec28: 2023-10-02 19:03:51,999 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed a897c4858188ad5e961aa6478f36ec28 2023-10-02 19:03:52,000 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=a897c4858188ad5e961aa6478f36ec28, regionState=CLOSED 2023-10-02 19:03:52,000 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418506.a897c4858188ad5e961aa6478f36ec28.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696273432000"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696273432000"}]},"ts":"1696273432000"} 2023-10-02 19:03:52,002 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-10-02 19:03:52,002 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure a897c4858188ad5e961aa6478f36ec28, server=jenkins-hbase20.apache.org,32897,1696273349258 in 174 msec 2023-10-02 19:03:52,004 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-10-02 19:03:52,004 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a897c4858188ad5e961aa6478f36ec28, UNASSIGN in 178 msec 2023-10-02 19:03:52,004 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696273432004"}]},"ts":"1696273432004"} 2023-10-02 19:03:52,006 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-10-02 19:03:52,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-02 19:03:52,237 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-10-02 19:03:52,242 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 421 msec 2023-10-02 19:03:52,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-02 19:03:52,430 INFO [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-10-02 19:03:52,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:52,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:52,438 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:52,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:52,439 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:52,441 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34425] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:52,444 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:52,444 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:52,444 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:52,444 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:52,444 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-02 19:03:52,445 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-02 19:03:52,445 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:52,445 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:03:52,445 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:03:52,445 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:52,446 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-10-02 19:03:52,446 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-10-02 19:03:52,446 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:03:52,446 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:03:52,446 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-02 19:03:52,446 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-02 19:03:52,446 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a897c4858188ad5e961aa6478f36ec28 2023-10-02 19:03:52,446 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed7197cae28228c56510694f2e2a0c3d 2023-10-02 19:03:52,446 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/65459ab8c0b07e9ea98e8c866b7c618d 2023-10-02 19:03:52,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-02 19:03:52,447 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 19:03:52,448 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 19:03:52,448 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 19:03:52,448 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 19:03:52,448 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a897c4858188ad5e961aa6478f36ec28/cf, FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a897c4858188ad5e961aa6478f36ec28/recovered.edits] 2023-10-02 19:03:52,449 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed7197cae28228c56510694f2e2a0c3d/cf, FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed7197cae28228c56510694f2e2a0c3d/recovered.edits] 2023-10-02 19:03:52,449 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/65459ab8c0b07e9ea98e8c866b7c618d/cf, FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/65459ab8c0b07e9ea98e8c866b7c618d/recovered.edits] 2023-10-02 19:03:52,453 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed7197cae28228c56510694f2e2a0c3d/cf/e6dde241f91a4cfe8a8510e0883c0df1 to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed7197cae28228c56510694f2e2a0c3d/cf/e6dde241f91a4cfe8a8510e0883c0df1 2023-10-02 19:03:52,454 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a897c4858188ad5e961aa6478f36ec28/cf/dfe21f8990e94172b059eb56429a15e5.65459ab8c0b07e9ea98e8c866b7c618d to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a897c4858188ad5e961aa6478f36ec28/cf/dfe21f8990e94172b059eb56429a15e5.65459ab8c0b07e9ea98e8c866b7c618d 2023-10-02 19:03:52,454 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/65459ab8c0b07e9ea98e8c866b7c618d/cf/dfe21f8990e94172b059eb56429a15e5 to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/65459ab8c0b07e9ea98e8c866b7c618d/cf/dfe21f8990e94172b059eb56429a15e5 2023-10-02 19:03:52,455 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a897c4858188ad5e961aa6478f36ec28/cf/e6dde241f91a4cfe8a8510e0883c0df1.ed7197cae28228c56510694f2e2a0c3d to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a897c4858188ad5e961aa6478f36ec28/cf/e6dde241f91a4cfe8a8510e0883c0df1.ed7197cae28228c56510694f2e2a0c3d 2023-10-02 19:03:52,456 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed7197cae28228c56510694f2e2a0c3d/recovered.edits/8.seqid to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed7197cae28228c56510694f2e2a0c3d/recovered.edits/8.seqid 2023-10-02 19:03:52,457 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed7197cae28228c56510694f2e2a0c3d 2023-10-02 19:03:52,457 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/65459ab8c0b07e9ea98e8c866b7c618d/recovered.edits/8.seqid to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/65459ab8c0b07e9ea98e8c866b7c618d/recovered.edits/8.seqid 2023-10-02 19:03:52,457 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a897c4858188ad5e961aa6478f36ec28/recovered.edits/12.seqid to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a897c4858188ad5e961aa6478f36ec28/recovered.edits/12.seqid 2023-10-02 19:03:52,458 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/65459ab8c0b07e9ea98e8c866b7c618d 2023-10-02 19:03:52,458 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a897c4858188ad5e961aa6478f36ec28 2023-10-02 19:03:52,458 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-02 19:03:52,459 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:52,461 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-10-02 19:03:52,463 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-10-02 19:03:52,464 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:52,464 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-10-02 19:03:52,464 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418506.a897c4858188ad5e961aa6478f36ec28.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696273432464"}]},"ts":"9223372036854775807"} 2023-10-02 19:03:52,466 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-10-02 19:03:52,466 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a897c4858188ad5e961aa6478f36ec28, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696273418506.a897c4858188ad5e961aa6478f36ec28.', STARTKEY => '', ENDKEY => ''}] 2023-10-02 19:03:52,466 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-10-02 19:03:52,466 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696273432466"}]},"ts":"9223372036854775807"} 2023-10-02 19:03:52,468 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-10-02 19:03:52,470 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:52,471 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 37 msec 2023-10-02 19:03:52,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-02 19:03:52,549 INFO [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-10-02 19:03:52,551 INFO [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:52,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:52,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:52,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-02 19:03:52,560 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696273432560"}]},"ts":"1696273432560"} 2023-10-02 19:03:52,562 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-10-02 19:03:52,564 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-10-02 19:03:52,565 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=53012b5690776af2ad146320d66230af, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=85caf1edfad4e9697da715af22456943, UNASSIGN}] 2023-10-02 19:03:52,567 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=85caf1edfad4e9697da715af22456943, UNASSIGN 2023-10-02 19:03:52,567 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=53012b5690776af2ad146320d66230af, UNASSIGN 2023-10-02 19:03:52,568 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=53012b5690776af2ad146320d66230af, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:52,568 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=85caf1edfad4e9697da715af22456943, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:52,568 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696273432568"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696273432568"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696273432568"}]},"ts":"1696273432568"} 2023-10-02 19:03:52,568 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696273432568"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696273432568"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696273432568"}]},"ts":"1696273432568"} 2023-10-02 19:03:52,570 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 53012b5690776af2ad146320d66230af, server=jenkins-hbase20.apache.org,34425,1696273349187}] 2023-10-02 19:03:52,570 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 85caf1edfad4e9697da715af22456943, server=jenkins-hbase20.apache.org,38887,1696273349229}] 2023-10-02 19:03:52,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-02 19:03:52,723 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 53012b5690776af2ad146320d66230af 2023-10-02 19:03:52,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 53012b5690776af2ad146320d66230af, disabling compactions & flushes 2023-10-02 19:03:52,724 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af. 2023-10-02 19:03:52,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af. 2023-10-02 19:03:52,724 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 85caf1edfad4e9697da715af22456943 2023-10-02 19:03:52,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af. after waiting 0 ms 2023-10-02 19:03:52,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 85caf1edfad4e9697da715af22456943, disabling compactions & flushes 2023-10-02 19:03:52,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943. 2023-10-02 19:03:52,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943. 2023-10-02 19:03:52,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943. after waiting 0 ms 2023-10-02 19:03:52,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943. 2023-10-02 19:03:52,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af. 2023-10-02 19:03:52,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion/85caf1edfad4e9697da715af22456943/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 19:03:52,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithMergeRegion/53012b5690776af2ad146320d66230af/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 19:03:52,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 19:03:52,747 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943. 2023-10-02 19:03:52,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 19:03:52,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 85caf1edfad4e9697da715af22456943: 2023-10-02 19:03:52,748 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af. 2023-10-02 19:03:52,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 53012b5690776af2ad146320d66230af: 2023-10-02 19:03:52,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 53012b5690776af2ad146320d66230af 2023-10-02 19:03:52,750 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=53012b5690776af2ad146320d66230af, regionState=CLOSED 2023-10-02 19:03:52,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 85caf1edfad4e9697da715af22456943 2023-10-02 19:03:52,750 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696273432750"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696273432750"}]},"ts":"1696273432750"} 2023-10-02 19:03:52,751 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=85caf1edfad4e9697da715af22456943, regionState=CLOSED 2023-10-02 19:03:52,751 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696273432751"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696273432751"}]},"ts":"1696273432751"} 2023-10-02 19:03:52,753 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-10-02 19:03:52,753 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 53012b5690776af2ad146320d66230af, server=jenkins-hbase20.apache.org,34425,1696273349187 in 182 msec 2023-10-02 19:03:52,754 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-10-02 19:03:52,754 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 85caf1edfad4e9697da715af22456943, server=jenkins-hbase20.apache.org,38887,1696273349229 in 182 msec 2023-10-02 19:03:52,754 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=53012b5690776af2ad146320d66230af, UNASSIGN in 188 msec 2023-10-02 19:03:52,755 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-10-02 19:03:52,755 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=85caf1edfad4e9697da715af22456943, UNASSIGN in 189 msec 2023-10-02 19:03:52,755 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696273432755"}]},"ts":"1696273432755"} 2023-10-02 19:03:52,756 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-10-02 19:03:52,757 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-10-02 19:03:52,759 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 207 msec 2023-10-02 19:03:52,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-02 19:03:52,865 INFO [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-10-02 19:03:52,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:52,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:52,873 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:52,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:52,874 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:52,876 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34425] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:52,878 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:52,878 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:52,878 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:52,878 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:52,878 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-02 19:03:52,878 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-02 19:03:52,878 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-02 19:03:52,878 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-02 19:03:52,879 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:52,879 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:52,879 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:03:52,879 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:52,879 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:52,879 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:03:52,879 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:03:52,879 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:03:52,879 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/53012b5690776af2ad146320d66230af 2023-10-02 19:03:52,879 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/85caf1edfad4e9697da715af22456943 2023-10-02 19:03:52,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-02 19:03:52,881 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/85caf1edfad4e9697da715af22456943/cf, FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/85caf1edfad4e9697da715af22456943/recovered.edits] 2023-10-02 19:03:52,881 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/53012b5690776af2ad146320d66230af/cf, FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/53012b5690776af2ad146320d66230af/recovered.edits] 2023-10-02 19:03:52,884 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/85caf1edfad4e9697da715af22456943/cf/7fe375e99b7746a4a3913a9a8d6ed2ba to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/85caf1edfad4e9697da715af22456943/cf/7fe375e99b7746a4a3913a9a8d6ed2ba 2023-10-02 19:03:52,884 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/53012b5690776af2ad146320d66230af/cf/255a9f8d38fe443191152395f6286bb4 to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/53012b5690776af2ad146320d66230af/cf/255a9f8d38fe443191152395f6286bb4 2023-10-02 19:03:52,886 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/85caf1edfad4e9697da715af22456943/recovered.edits/9.seqid to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/85caf1edfad4e9697da715af22456943/recovered.edits/9.seqid 2023-10-02 19:03:52,887 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/53012b5690776af2ad146320d66230af/recovered.edits/9.seqid to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/53012b5690776af2ad146320d66230af/recovered.edits/9.seqid 2023-10-02 19:03:52,887 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/85caf1edfad4e9697da715af22456943 2023-10-02 19:03:52,887 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/53012b5690776af2ad146320d66230af 2023-10-02 19:03:52,887 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-02 19:03:52,887 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-02 19:03:52,888 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-10-02 19:03:52,891 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231002892adbf220e048c28d38bb8fe22f5cdb to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231002892adbf220e048c28d38bb8fe22f5cdb 2023-10-02 19:03:52,892 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310029cc733dddaa0402f99dd1cd7becd9d5e to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310029cc733dddaa0402f99dd1cd7becd9d5e 2023-10-02 19:03:52,893 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-02 19:03:52,894 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:52,896 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-10-02 19:03:52,897 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-10-02 19:03:52,898 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:52,898 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-10-02 19:03:52,899 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696273432898"}]},"ts":"9223372036854775807"} 2023-10-02 19:03:52,899 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696273432898"}]},"ts":"9223372036854775807"} 2023-10-02 19:03:52,900 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-02 19:03:52,900 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 53012b5690776af2ad146320d66230af, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696273417110.53012b5690776af2ad146320d66230af.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 85caf1edfad4e9697da715af22456943, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696273417110.85caf1edfad4e9697da715af22456943.', STARTKEY => '1', ENDKEY => ''}] 2023-10-02 19:03:52,900 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-10-02 19:03:52,900 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696273432900"}]},"ts":"9223372036854775807"} 2023-10-02 19:03:52,901 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-10-02 19:03:52,903 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:52,904 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 36 msec 2023-10-02 19:03:52,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-02 19:03:52,982 INFO [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-10-02 19:03:52,999 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-02 19:03:53,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:53,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-02 19:03:53,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 19:03:53,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-10-02 19:03:53,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 19:03:53,033 INFO [Listener at jenkins-hbase20.apache.org/42825] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=763 (was 756) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb2bac33-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1560130904_1 at /127.0.0.1:38010 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4075 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb2bac33-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1470868269) connection to jenkins-hbase20.apache.org/148.251.75.209:35423 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1560130904_1 at /127.0.0.1:33964 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1557508828_17 at /127.0.0.1:38036 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb2bac33-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1557508828_17 at /127.0.0.1:33992 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb2bac33-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb2bac33-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb2bac33-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=924 (was 911) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=234 (was 242), ProcessCount=169 (was 169), AvailableMemoryMB=4486 (was 4620) 2023-10-02 19:03:53,033 WARN [Listener at jenkins-hbase20.apache.org/42825] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-10-02 19:03:53,049 INFO [Listener at jenkins-hbase20.apache.org/42825] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=763, OpenFileDescriptor=924, MaxFileDescriptor=60000, SystemLoadAverage=234, ProcessCount=169, AvailableMemoryMB=4486 2023-10-02 19:03:53,049 WARN [Listener at jenkins-hbase20.apache.org/42825] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-10-02 19:03:53,051 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-02 19:03:53,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-02 19:03:53,054 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 19:03:53,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-10-02 19:03:53,054 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 19:03:53,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-02 19:03:53,056 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testEmptyExportFileSystemState/8d5d1261d4975eeb67a2025bef2ed403 2023-10-02 19:03:53,056 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testEmptyExportFileSystemState/bbe0619123048c5d3e2e0bccb5b0eff9 2023-10-02 19:03:53,056 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testEmptyExportFileSystemState/8d5d1261d4975eeb67a2025bef2ed403 empty. 2023-10-02 19:03:53,057 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testEmptyExportFileSystemState/bbe0619123048c5d3e2e0bccb5b0eff9 empty. 2023-10-02 19:03:53,057 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testEmptyExportFileSystemState/8d5d1261d4975eeb67a2025bef2ed403 2023-10-02 19:03:53,057 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testEmptyExportFileSystemState/bbe0619123048c5d3e2e0bccb5b0eff9 2023-10-02 19:03:53,057 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-02 19:03:53,068 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-02 19:03:53,071 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8d5d1261d4975eeb67a2025bef2ed403, NAME => 'testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp 2023-10-02 19:03:53,071 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => bbe0619123048c5d3e2e0bccb5b0eff9, NAME => 'testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp 2023-10-02 19:03:53,081 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:03:53,082 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:03:53,082 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 8d5d1261d4975eeb67a2025bef2ed403, disabling compactions & flushes 2023-10-02 19:03:53,082 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing bbe0619123048c5d3e2e0bccb5b0eff9, disabling compactions & flushes 2023-10-02 19:03:53,082 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403. 2023-10-02 19:03:53,082 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9. 2023-10-02 19:03:53,082 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403. 2023-10-02 19:03:53,082 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9. 2023-10-02 19:03:53,082 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403. after waiting 0 ms 2023-10-02 19:03:53,082 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9. after waiting 0 ms 2023-10-02 19:03:53,082 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403. 2023-10-02 19:03:53,082 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9. 2023-10-02 19:03:53,082 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403. 2023-10-02 19:03:53,082 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9. 2023-10-02 19:03:53,082 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 8d5d1261d4975eeb67a2025bef2ed403: 2023-10-02 19:03:53,082 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for bbe0619123048c5d3e2e0bccb5b0eff9: 2023-10-02 19:03:53,086 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 19:03:53,087 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696273433087"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696273433087"}]},"ts":"1696273433087"} 2023-10-02 19:03:53,087 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696273433087"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696273433087"}]},"ts":"1696273433087"} 2023-10-02 19:03:53,089 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-02 19:03:53,090 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 19:03:53,090 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696273433090"}]},"ts":"1696273433090"} 2023-10-02 19:03:53,091 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-10-02 19:03:53,093 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-10-02 19:03:53,094 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 19:03:53,094 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 19:03:53,094 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 19:03:53,094 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 19:03:53,094 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8d5d1261d4975eeb67a2025bef2ed403, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bbe0619123048c5d3e2e0bccb5b0eff9, ASSIGN}] 2023-10-02 19:03:53,096 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bbe0619123048c5d3e2e0bccb5b0eff9, ASSIGN 2023-10-02 19:03:53,096 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8d5d1261d4975eeb67a2025bef2ed403, ASSIGN 2023-10-02 19:03:53,097 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bbe0619123048c5d3e2e0bccb5b0eff9, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38887,1696273349229; forceNewPlan=false, retain=false 2023-10-02 19:03:53,097 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8d5d1261d4975eeb67a2025bef2ed403, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34425,1696273349187; forceNewPlan=false, retain=false 2023-10-02 19:03:53,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-02 19:03:53,247 INFO [jenkins-hbase20:32777] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-02 19:03:53,252 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=bbe0619123048c5d3e2e0bccb5b0eff9, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:53,252 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=8d5d1261d4975eeb67a2025bef2ed403, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:53,253 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696273433252"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696273433252"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696273433252"}]},"ts":"1696273433252"} 2023-10-02 19:03:53,253 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696273433252"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696273433252"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696273433252"}]},"ts":"1696273433252"} 2023-10-02 19:03:53,258 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure bbe0619123048c5d3e2e0bccb5b0eff9, server=jenkins-hbase20.apache.org,38887,1696273349229}] 2023-10-02 19:03:53,260 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 8d5d1261d4975eeb67a2025bef2ed403, server=jenkins-hbase20.apache.org,34425,1696273349187}] 2023-10-02 19:03:53,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-02 19:03:53,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9. 2023-10-02 19:03:53,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bbe0619123048c5d3e2e0bccb5b0eff9, NAME => 'testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9.', STARTKEY => '1', ENDKEY => ''} 2023-10-02 19:03:53,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9. service=AccessControlService 2023-10-02 19:03:53,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403. 2023-10-02 19:03:53,419 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 19:03:53,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8d5d1261d4975eeb67a2025bef2ed403, NAME => 'testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403.', STARTKEY => '', ENDKEY => '1'} 2023-10-02 19:03:53,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState bbe0619123048c5d3e2e0bccb5b0eff9 2023-10-02 19:03:53,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:03:53,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for bbe0619123048c5d3e2e0bccb5b0eff9 2023-10-02 19:03:53,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for bbe0619123048c5d3e2e0bccb5b0eff9 2023-10-02 19:03:53,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403. service=AccessControlService 2023-10-02 19:03:53,420 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 19:03:53,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 8d5d1261d4975eeb67a2025bef2ed403 2023-10-02 19:03:53,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:03:53,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 8d5d1261d4975eeb67a2025bef2ed403 2023-10-02 19:03:53,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 8d5d1261d4975eeb67a2025bef2ed403 2023-10-02 19:03:53,421 INFO [StoreOpener-bbe0619123048c5d3e2e0bccb5b0eff9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bbe0619123048c5d3e2e0bccb5b0eff9 2023-10-02 19:03:53,422 INFO [StoreOpener-8d5d1261d4975eeb67a2025bef2ed403-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8d5d1261d4975eeb67a2025bef2ed403 2023-10-02 19:03:53,423 DEBUG [StoreOpener-bbe0619123048c5d3e2e0bccb5b0eff9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testEmptyExportFileSystemState/bbe0619123048c5d3e2e0bccb5b0eff9/cf 2023-10-02 19:03:53,423 DEBUG [StoreOpener-bbe0619123048c5d3e2e0bccb5b0eff9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testEmptyExportFileSystemState/bbe0619123048c5d3e2e0bccb5b0eff9/cf 2023-10-02 19:03:53,423 DEBUG [StoreOpener-8d5d1261d4975eeb67a2025bef2ed403-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testEmptyExportFileSystemState/8d5d1261d4975eeb67a2025bef2ed403/cf 2023-10-02 19:03:53,423 DEBUG [StoreOpener-8d5d1261d4975eeb67a2025bef2ed403-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testEmptyExportFileSystemState/8d5d1261d4975eeb67a2025bef2ed403/cf 2023-10-02 19:03:53,424 INFO [StoreOpener-bbe0619123048c5d3e2e0bccb5b0eff9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bbe0619123048c5d3e2e0bccb5b0eff9 columnFamilyName cf 2023-10-02 19:03:53,424 INFO [StoreOpener-8d5d1261d4975eeb67a2025bef2ed403-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8d5d1261d4975eeb67a2025bef2ed403 columnFamilyName cf 2023-10-02 19:03:53,425 INFO [StoreOpener-bbe0619123048c5d3e2e0bccb5b0eff9-1] regionserver.HStore(310): Store=bbe0619123048c5d3e2e0bccb5b0eff9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 19:03:53,425 INFO [StoreOpener-8d5d1261d4975eeb67a2025bef2ed403-1] regionserver.HStore(310): Store=8d5d1261d4975eeb67a2025bef2ed403/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 19:03:53,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testEmptyExportFileSystemState/8d5d1261d4975eeb67a2025bef2ed403 2023-10-02 19:03:53,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testEmptyExportFileSystemState/bbe0619123048c5d3e2e0bccb5b0eff9 2023-10-02 19:03:53,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testEmptyExportFileSystemState/8d5d1261d4975eeb67a2025bef2ed403 2023-10-02 19:03:53,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testEmptyExportFileSystemState/bbe0619123048c5d3e2e0bccb5b0eff9 2023-10-02 19:03:53,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for bbe0619123048c5d3e2e0bccb5b0eff9 2023-10-02 19:03:53,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 8d5d1261d4975eeb67a2025bef2ed403 2023-10-02 19:03:53,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testEmptyExportFileSystemState/bbe0619123048c5d3e2e0bccb5b0eff9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 19:03:53,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testEmptyExportFileSystemState/8d5d1261d4975eeb67a2025bef2ed403/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 19:03:53,433 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened bbe0619123048c5d3e2e0bccb5b0eff9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60147185, jitterRate=-0.10373710095882416}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 19:03:53,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for bbe0619123048c5d3e2e0bccb5b0eff9: 2023-10-02 19:03:53,433 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 8d5d1261d4975eeb67a2025bef2ed403; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72847934, jitterRate=0.08551880717277527}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 19:03:53,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 8d5d1261d4975eeb67a2025bef2ed403: 2023-10-02 19:03:53,433 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9., pid=93, masterSystemTime=1696273433411 2023-10-02 19:03:53,433 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403., pid=94, masterSystemTime=1696273433412 2023-10-02 19:03:53,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9. 2023-10-02 19:03:53,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9. 2023-10-02 19:03:53,435 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=bbe0619123048c5d3e2e0bccb5b0eff9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:53,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403. 2023-10-02 19:03:53,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403. 2023-10-02 19:03:53,436 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696273433435"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696273433435"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696273433435"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696273433435"}]},"ts":"1696273433435"} 2023-10-02 19:03:53,436 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=8d5d1261d4975eeb67a2025bef2ed403, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:53,436 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696273433436"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696273433436"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696273433436"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696273433436"}]},"ts":"1696273433436"} 2023-10-02 19:03:53,438 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-10-02 19:03:53,438 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure bbe0619123048c5d3e2e0bccb5b0eff9, server=jenkins-hbase20.apache.org,38887,1696273349229 in 179 msec 2023-10-02 19:03:53,438 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-10-02 19:03:53,438 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 8d5d1261d4975eeb67a2025bef2ed403, server=jenkins-hbase20.apache.org,34425,1696273349187 in 177 msec 2023-10-02 19:03:53,439 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bbe0619123048c5d3e2e0bccb5b0eff9, ASSIGN in 344 msec 2023-10-02 19:03:53,440 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-10-02 19:03:53,440 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8d5d1261d4975eeb67a2025bef2ed403, ASSIGN in 344 msec 2023-10-02 19:03:53,440 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 19:03:53,440 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696273433440"}]},"ts":"1696273433440"} 2023-10-02 19:03:53,441 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-10-02 19:03:53,443 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 19:03:53,443 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-10-02 19:03:53,444 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34425] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-02 19:03:53,445 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:03:53,445 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:03:53,445 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:03:53,445 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:03:53,446 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-02 19:03:53,446 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-02 19:03:53,446 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-02 19:03:53,446 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-02 19:03:53,447 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 395 msec 2023-10-02 19:03:53,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-02 19:03:53,662 INFO [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-10-02 19:03:53,668 DEBUG [Listener at jenkins-hbase20.apache.org/42825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-02 19:03:53,669 DEBUG [Listener at jenkins-hbase20.apache.org/42825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403. 2023-10-02 19:03:53,672 INFO [Listener at jenkins-hbase20.apache.org/42825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 19:03:53,692 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 19:03:53,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696273433692 (current time:1696273433692). 2023-10-02 19:03:53,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 19:03:53,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(139): Connect 0x2eb16391 to 127.0.0.1:60248 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 19:03:53,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5cfaa4b5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 19:03:53,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:03:53,705 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43890, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:03:53,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2eb16391 to 127.0.0.1:60248 2023-10-02 19:03:53,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:03:53,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(139): Connect 0x4559de51 to 127.0.0.1:60248 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 19:03:53,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60d18080, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 19:03:53,724 DEBUG [hconnection-0x69074f23-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:03:53,727 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43904, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:03:53,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:03:53,735 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:35338, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:03:53,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4559de51 to 127.0.0.1:60248 2023-10-02 19:03:53,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:03:53,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-02 19:03:53,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 19:03:53,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 19:03:53,740 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot, current working dir path: hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 19:03:53,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-02 19:03:53,747 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-02 19:03:53,747 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696274033747 2023-10-02 19:03:53,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 19:03:53,747 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-02 19:03:53,749 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 19:03:53,749 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 19:03:53,750 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-02 19:03:53,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-02 19:03:53,751 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-10-02 19:03:53,754 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-02 19:03:53,755 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696274033755 2023-10-02 19:03:53,765 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,765 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-10-02 19:03:53,765 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:03:53,767 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-02 19:03:53,767 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-02 19:03:53,767 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,767 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,770 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:53,770 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:53,770 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:53,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:53,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:53,770 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:53,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:53,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:53,770 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:53,770 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:53,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:53,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:53,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,771 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:53,771 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 19:03:53,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,771 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,771 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,771 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-02 19:03:53,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-02 19:03:53,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,771 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-02 19:03:53,771 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-02 19:03:53,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-02 19:03:53,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,772 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,772 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-02 19:03:53,772 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-02 19:03:53,772 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:03:53,772 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,772 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-02 19:03:53,772 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:03:53,778 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-02 19:03:53,778 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-02 19:03:53,778 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,778 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-02 19:03:53,779 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-02 19:03:53,779 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:03:53,779 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-02 19:03:53,778 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38887,1696273349229' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-02 19:03:53,780 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34425,1696273349187' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-02 19:03:53,780 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-02 19:03:53,780 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-02 19:03:53,780 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,32897,1696273349258' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-02 19:03:53,781 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:53,781 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,781 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,781 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:53,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:03:53,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:03:53,781 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:53,782 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,782 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,782 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:03:53,782 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:03:53,782 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:03:53,782 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:03:53,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:03:53,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:53,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:53,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:53,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:03:53,784 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38887,1696273349229' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-02 19:03:53,784 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5985a6f9[Count = 1] remaining members to acquire global barrier 2023-10-02 19:03:53,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:53,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:03:53,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:03:53,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:03:53,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:03:53,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:53,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:53,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:53,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:03:53,786 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34425,1696273349187' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-02 19:03:53,786 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5985a6f9[Count = 0] remaining members to acquire global barrier 2023-10-02 19:03:53,786 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-02 19:03:53,786 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,790 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,790 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,790 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,790 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:53,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,790 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-02 19:03:53,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,790 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:53,790 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 19:03:53,790 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-02 19:03:53,790 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-02 19:03:53,790 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-02 19:03:53,791 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,32897,1696273349258' in zk 2023-10-02 19:03:53,791 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 19:03:53,791 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 19:03:53,791 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9. 2023-10-02 19:03:53,791 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9. started... 2023-10-02 19:03:53,791 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-02 19:03:53,791 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:03:53,791 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-02 19:03:53,794 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 19:03:53,796 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 19:03:53,796 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bbe0619123048c5d3e2e0bccb5b0eff9: 2023-10-02 19:03:53,796 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403. 2023-10-02 19:03:53,796 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403. started... 2023-10-02 19:03:53,796 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,796 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 19:03:53,796 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8d5d1261d4975eeb67a2025bef2ed403: 2023-10-02 19:03:53,796 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 19:03:53,796 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,796 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 19:03:53,796 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 19:03:53,802 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9. completed. 2023-10-02 19:03:53,803 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403. completed. 2023-10-02 19:03:53,803 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403. 2023-10-02 19:03:53,803 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9. 2023-10-02 19:03:53,803 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 19:03:53,803 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 19:03:53,803 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 19:03:53,803 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 19:03:53,803 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:53,803 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:53,803 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-02 19:03:53,803 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-02 19:03:53,803 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,34425,1696273349187' in zk 2023-10-02 19:03:53,803 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,38887,1696273349229' in zk 2023-10-02 19:03:53,804 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:53,804 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-02 19:03:53,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:53,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:03:53,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:03:53,804 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:03:53,804 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:53,804 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-02 19:03:53,804 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-02 19:03:53,805 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:03:53,806 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-02 19:03:53,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:03:53,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:03:53,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:53,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:53,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:53,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:03:53,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:53,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:53,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:53,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,34425,1696273349187': 2023-10-02 19:03:53,808 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34425,1696273349187' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-02 19:03:53,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:53,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:03:53,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:03:53,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:03:53,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:03:53,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:53,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:53,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:53,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:03:53,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:53,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:53,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:53,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,38887,1696273349229': 2023-10-02 19:03:53,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38887,1696273349229' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-02 19:03:53,811 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-10-02 19:03:53,811 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 19:03:53,811 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 19:03:53,811 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,811 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 19:03:53,823 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,823 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:03:53,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:03:53,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,823 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:53,823 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,823 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,823 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:53,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:53,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:03:53,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,823 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:53,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,824 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:53,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:53,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:53,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:53,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:53,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,824 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:53,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:53,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:03:53,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,825 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:53,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:53,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:53,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:53,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:03:53,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,826 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:53,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:53,827 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:53,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:53,827 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:53,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:53,831 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:53,832 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:53,832 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:53,832 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,832 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,832 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:53,832 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:53,832 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-02 19:03:53,832 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:53,832 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:53,832 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,832 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:53,832 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:03:53,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:53,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:53,832 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:53,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:53,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:53,832 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:53,832 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,832 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:53,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:53,834 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 19:03:53,834 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:53,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:53,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:53,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:53,834 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:53,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:53,835 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:53,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:53,835 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,835 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-02 19:03:53,841 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,849 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 19:03:53,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 19:03:53,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-02 19:03:53,851 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 19:03:53,856 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,857 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-02 19:03:53,857 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,857 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:53,857 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696273433747Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696273433841 (+94 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696273433841Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1696273433841Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1696273433844 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696273433850 (+6 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696273433857 (+7 ms) 2023-10-02 19:03:53,862 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-02 19:03:53,864 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 113 msec 2023-10-02 19:03:54,051 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 19:03:54,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 19:03:54,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 19:03:54,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34425] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 19:03:54,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38887] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 19:03:54,065 DEBUG [Listener at jenkins-hbase20.apache.org/42825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-02 19:03:54,065 DEBUG [Listener at jenkins-hbase20.apache.org/42825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403. 2023-10-02 19:03:54,066 INFO [Listener at jenkins-hbase20.apache.org/42825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 19:03:54,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 19:03:54,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696273434077 (current time:1696273434077). 2023-10-02 19:03:54,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 19:03:54,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(139): Connect 0x35501ba1 to 127.0.0.1:60248 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 19:03:54,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46ca196, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 19:03:54,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:03:54,085 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43910, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:03:54,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35501ba1 to 127.0.0.1:60248 2023-10-02 19:03:54,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:03:54,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(139): Connect 0x3eeb34c8 to 127.0.0.1:60248 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 19:03:54,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b53bda7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 19:03:54,094 DEBUG [hconnection-0x6a52dd4a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:03:54,096 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43918, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:03:54,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:03:54,101 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:35346, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:03:54,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3eeb34c8 to 127.0.0.1:60248 2023-10-02 19:03:54,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:03:54,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-02 19:03:54,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 19:03:54,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 19:03:54,106 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot, current working dir path: hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 19:03:54,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-02 19:03:54,109 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-02 19:03:54,110 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696274034110 2023-10-02 19:03:54,110 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-02 19:03:54,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 19:03:54,111 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 19:03:54,111 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 19:03:54,112 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-02 19:03:54,113 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-02 19:03:54,114 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-10-02 19:03:54,115 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-02 19:03:54,115 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696274034115 2023-10-02 19:03:54,125 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,125 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-10-02 19:03:54,125 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:03:54,126 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-02 19:03:54,126 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-02 19:03:54,126 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,126 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,127 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:54,127 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:54,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:54,127 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:54,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:54,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:54,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:54,127 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:54,128 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:54,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,128 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:54,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:54,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:54,128 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:54,128 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 19:03:54,128 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,128 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,128 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-02 19:03:54,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-02 19:03:54,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,128 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-02 19:03:54,128 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-02 19:03:54,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-02 19:03:54,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,129 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-02 19:03:54,129 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,129 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,129 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-02 19:03:54,129 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-02 19:03:54,129 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:03:54,129 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,130 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-02 19:03:54,130 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-02 19:03:54,130 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:03:54,129 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:03:54,131 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-02 19:03:54,134 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-02 19:03:54,130 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-02 19:03:54,134 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,32897,1696273349258' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-02 19:03:54,134 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-02 19:03:54,134 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38887,1696273349229' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-02 19:03:54,134 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-02 19:03:54,134 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34425,1696273349187' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-02 19:03:54,140 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,140 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:54,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:54,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:03:54,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:03:54,141 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:54,141 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,142 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:03:54,141 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,142 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:03:54,142 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,142 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:03:54,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:03:54,142 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,142 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:03:54,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:54,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:54,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:54,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:03:54,144 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38887,1696273349229' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-02 19:03:54,144 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e70720e[Count = 1] remaining members to acquire global barrier 2023-10-02 19:03:54,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:54,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:03:54,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:03:54,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:03:54,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:03:54,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:54,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:54,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:54,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:03:54,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34425,1696273349187' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-02 19:03:54,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e70720e[Count = 0] remaining members to acquire global barrier 2023-10-02 19:03:54,147 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-02 19:03:54,147 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,148 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,148 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,148 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,148 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-02 19:03:54,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,148 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:54,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,149 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 19:03:54,149 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 19:03:54,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,149 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:54,149 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 19:03:54,149 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-02 19:03:54,149 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9. 2023-10-02 19:03:54,149 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-02 19:03:54,149 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 19:03:54,149 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 19:03:54,149 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9. started... 2023-10-02 19:03:54,149 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403. 2023-10-02 19:03:54,149 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-02 19:03:54,149 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,32897,1696273349258' in zk 2023-10-02 19:03:54,149 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403. started... 2023-10-02 19:03:54,150 INFO [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] regionserver.HRegion(2745): Flushing bbe0619123048c5d3e2e0bccb5b0eff9 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-02 19:03:54,150 INFO [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8d5d1261d4975eeb67a2025bef2ed403 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-02 19:03:54,151 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-02 19:03:54,151 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:03:54,151 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-02 19:03:54,171 INFO [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310023c9022817f1542d3907dacbd96f17cff to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310023c9022817f1542d3907dacbd96f17cff 2023-10-02 19:03:54,172 INFO [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310027174f2d6f73242f7b028043172fbd595 to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310027174f2d6f73242f7b028043172fbd595 2023-10-02 19:03:54,180 INFO [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testEmptyExportFileSystemState/8d5d1261d4975eeb67a2025bef2ed403/.tmp/cf/94699414102d40a898d6d3ee4b08ab0f 2023-10-02 19:03:54,180 INFO [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testEmptyExportFileSystemState/bbe0619123048c5d3e2e0bccb5b0eff9/.tmp/cf/dd8af99397e745149b4bda758e81981c 2023-10-02 19:03:54,185 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testEmptyExportFileSystemState/8d5d1261d4975eeb67a2025bef2ed403/.tmp/cf/94699414102d40a898d6d3ee4b08ab0f as hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testEmptyExportFileSystemState/8d5d1261d4975eeb67a2025bef2ed403/cf/94699414102d40a898d6d3ee4b08ab0f 2023-10-02 19:03:54,185 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testEmptyExportFileSystemState/bbe0619123048c5d3e2e0bccb5b0eff9/.tmp/cf/dd8af99397e745149b4bda758e81981c as hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testEmptyExportFileSystemState/bbe0619123048c5d3e2e0bccb5b0eff9/cf/dd8af99397e745149b4bda758e81981c 2023-10-02 19:03:54,191 INFO [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testEmptyExportFileSystemState/8d5d1261d4975eeb67a2025bef2ed403/cf/94699414102d40a898d6d3ee4b08ab0f, entries=4, sequenceid=6, filesize=5.6 K 2023-10-02 19:03:54,191 INFO [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testEmptyExportFileSystemState/bbe0619123048c5d3e2e0bccb5b0eff9/cf/dd8af99397e745149b4bda758e81981c, entries=46, sequenceid=6, filesize=12.9 K 2023-10-02 19:03:54,192 INFO [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 8d5d1261d4975eeb67a2025bef2ed403 in 42ms, sequenceid=6, compaction requested=false 2023-10-02 19:03:54,192 INFO [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for bbe0619123048c5d3e2e0bccb5b0eff9 in 43ms, sequenceid=6, compaction requested=false 2023-10-02 19:03:54,192 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-10-02 19:03:54,192 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-10-02 19:03:54,195 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bbe0619123048c5d3e2e0bccb5b0eff9: 2023-10-02 19:03:54,195 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8d5d1261d4975eeb67a2025bef2ed403: 2023-10-02 19:03:54,195 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,195 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,196 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 19:03:54,196 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 19:03:54,196 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testEmptyExportFileSystemState/8d5d1261d4975eeb67a2025bef2ed403/cf/94699414102d40a898d6d3ee4b08ab0f] hfiles 2023-10-02 19:03:54,196 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testEmptyExportFileSystemState/bbe0619123048c5d3e2e0bccb5b0eff9/cf/dd8af99397e745149b4bda758e81981c] hfiles 2023-10-02 19:03:54,196 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testEmptyExportFileSystemState/8d5d1261d4975eeb67a2025bef2ed403/cf/94699414102d40a898d6d3ee4b08ab0f for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,196 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testEmptyExportFileSystemState/bbe0619123048c5d3e2e0bccb5b0eff9/cf/dd8af99397e745149b4bda758e81981c for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,202 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9. completed. 2023-10-02 19:03:54,203 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9. 2023-10-02 19:03:54,203 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403. completed. 2023-10-02 19:03:54,203 DEBUG [rs(jenkins-hbase20.apache.org,34425,1696273349187)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403. 2023-10-02 19:03:54,203 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 19:03:54,203 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 19:03:54,203 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 19:03:54,203 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 19:03:54,203 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:54,203 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:54,203 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-02 19:03:54,203 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-02 19:03:54,203 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,34425,1696273349187' in zk 2023-10-02 19:03:54,203 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,38887,1696273349229' in zk 2023-10-02 19:03:54,204 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:54,204 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-02 19:03:54,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:54,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:03:54,204 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:03:54,204 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-02 19:03:54,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:03:54,205 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-02 19:03:54,205 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:03:54,205 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:54,205 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-02 19:03:54,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:03:54,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:03:54,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:54,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:54,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:54,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:03:54,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:54,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:54,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:54,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,34425,1696273349187': 2023-10-02 19:03:54,209 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34425,1696273349187' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-02 19:03:54,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:54,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:03:54,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:03:54,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:03:54,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:03:54,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:54,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:54,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:54,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:03:54,211 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 19:03:54,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:54,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 19:03:54,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:54,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-02 19:03:54,212 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 19:03:54,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:54,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,38887,1696273349229': 2023-10-02 19:03:54,213 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38887,1696273349229' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-02 19:03:54,213 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-10-02 19:03:54,213 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 19:03:54,213 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 19:03:54,213 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,213 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 19:03:54,215 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,215 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:03:54,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:03:54,215 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,215 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:54,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,215 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,215 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:54,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,215 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:54,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:03:54,215 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:54,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:54,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:54,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:54,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:54,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:54,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:54,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,216 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:54,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:03:54,216 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:54,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:54,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:54,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:54,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:03:54,218 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:54,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,218 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:54,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:54,219 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:54,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:54,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:54,223 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:54,223 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,223 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:54,223 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:54,223 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:54,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:54,223 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:03:54,223 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:03:54,223 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:54,223 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:54,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:54,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:54,225 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:54,223 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:54,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:03:54,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:03:54,223 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:03:54,225 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-02 19:03:54,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:54,226 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,225 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,226 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 19:03:54,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:54,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:54,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:54,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:03:54,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:03:54,226 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:03:54,226 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,226 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:03:54,226 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:03:54,226 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,226 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,227 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310027174f2d6f73242f7b028043172fbd595, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310023c9022817f1542d3907dacbd96f17cff] mob files 2023-10-02 19:03:54,227 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310027174f2d6f73242f7b028043172fbd595 2023-10-02 19:03:54,227 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310023c9022817f1542d3907dacbd96f17cff 2023-10-02 19:03:54,235 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,236 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,259 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,259 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-02 19:03:54,259 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,260 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,260 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696273434110Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696273434235 (+125 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1696273434235Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1696273434235Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1696273434241 (+6 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1696273434252 (+11 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696273434259 (+7 ms) 2023-10-02 19:03:54,262 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-02 19:03:54,263 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 151 msec 2023-10-02 19:03:54,413 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 19:03:54,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 19:03:54,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 19:03:54,414 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273434414 2023-10-02 19:03:54,414 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46307, tgtDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273434414, rawTgtDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273434414, srcFsUri=hdfs://localhost:46307, srcDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6 2023-10-02 19:03:54,432 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46307, inputRoot=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6 2023-10-02 19:03:54,432 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2119071550_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273434414, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273434414/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,432 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46307, inputRoot=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6, snapshotDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-10-02 19:03:54,437 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273434414/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:03:54,453 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:54,454 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:54,454 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:54,454 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:55,156 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/hadoop-7548074620309857631.jar 2023-10-02 19:03:55,156 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:55,156 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:55,209 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/hadoop-2623295611478213816.jar 2023-10-02 19:03:55,210 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:55,210 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:55,210 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:55,211 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:55,211 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:55,211 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-02 19:03:55,212 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-02 19:03:55,212 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-02 19:03:55,212 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-02 19:03:55,212 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-02 19:03:55,213 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-02 19:03:55,213 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-02 19:03:55,213 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-02 19:03:55,214 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-02 19:03:55,214 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-02 19:03:55,214 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-02 19:03:55,215 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 19:03:55,215 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 19:03:55,216 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 19:03:55,216 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 19:03:55,216 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 19:03:55,216 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 19:03:55,217 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 19:03:55,562 WARN [Listener at jenkins-hbase20.apache.org/42825] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-02 19:03:55,564 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-10-02 19:03:56,075 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 19:03:56,075 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 19:03:56,078 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696273355352_0005_000001 (auth:SIMPLE) 2023-10-02 19:03:56,890 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696273355352_0006_000001 (auth:SIMPLE) 2023-10-02 19:03:57,596 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-02 19:04:00,135 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696273355352_0006_000001 (auth:SIMPLE) 2023-10-02 19:04:02,921 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-02 19:04:02,921 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-02 19:04:02,926 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:04:02,926 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-02 19:04:02,927 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-02 19:04:02,927 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1557508828_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:04:02,927 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(367): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-02 19:04:02,927 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(367): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-02 19:04:02,927 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1557508828_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273434414/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273434414/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:04:02,928 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(367): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273434414/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-02 19:04:02,928 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(367): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273434414/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-02 19:04:02,932 INFO [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-10-02 19:04:02,932 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testEmptyExportFileSystemState 2023-10-02 19:04:02,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-02 19:04:02,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-02 19:04:02,936 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696273442936"}]},"ts":"1696273442936"} 2023-10-02 19:04:02,937 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-10-02 19:04:02,939 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-10-02 19:04:02,939 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8d5d1261d4975eeb67a2025bef2ed403, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bbe0619123048c5d3e2e0bccb5b0eff9, UNASSIGN}] 2023-10-02 19:04:02,941 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8d5d1261d4975eeb67a2025bef2ed403, UNASSIGN 2023-10-02 19:04:02,942 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bbe0619123048c5d3e2e0bccb5b0eff9, UNASSIGN 2023-10-02 19:04:02,942 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=8d5d1261d4975eeb67a2025bef2ed403, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:04:02,942 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=bbe0619123048c5d3e2e0bccb5b0eff9, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:02,942 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696273442942"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696273442942"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696273442942"}]},"ts":"1696273442942"} 2023-10-02 19:04:02,942 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696273442942"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696273442942"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696273442942"}]},"ts":"1696273442942"} 2023-10-02 19:04:02,944 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure bbe0619123048c5d3e2e0bccb5b0eff9, server=jenkins-hbase20.apache.org,38887,1696273349229}] 2023-10-02 19:04:02,944 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 8d5d1261d4975eeb67a2025bef2ed403, server=jenkins-hbase20.apache.org,34425,1696273349187}] 2023-10-02 19:04:03,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-02 19:04:03,096 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close bbe0619123048c5d3e2e0bccb5b0eff9 2023-10-02 19:04:03,096 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 8d5d1261d4975eeb67a2025bef2ed403 2023-10-02 19:04:03,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing bbe0619123048c5d3e2e0bccb5b0eff9, disabling compactions & flushes 2023-10-02 19:04:03,096 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9. 2023-10-02 19:04:03,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 8d5d1261d4975eeb67a2025bef2ed403, disabling compactions & flushes 2023-10-02 19:04:03,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9. 2023-10-02 19:04:03,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9. after waiting 0 ms 2023-10-02 19:04:03,096 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403. 2023-10-02 19:04:03,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403. 2023-10-02 19:04:03,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403. after waiting 0 ms 2023-10-02 19:04:03,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403. 2023-10-02 19:04:03,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9. 2023-10-02 19:04:03,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testEmptyExportFileSystemState/8d5d1261d4975eeb67a2025bef2ed403/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 19:04:03,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testEmptyExportFileSystemState/bbe0619123048c5d3e2e0bccb5b0eff9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 19:04:03,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 19:04:03,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 19:04:03,110 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403. 2023-10-02 19:04:03,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 8d5d1261d4975eeb67a2025bef2ed403: 2023-10-02 19:04:03,110 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9. 2023-10-02 19:04:03,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for bbe0619123048c5d3e2e0bccb5b0eff9: 2023-10-02 19:04:03,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed bbe0619123048c5d3e2e0bccb5b0eff9 2023-10-02 19:04:03,112 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=bbe0619123048c5d3e2e0bccb5b0eff9, regionState=CLOSED 2023-10-02 19:04:03,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 8d5d1261d4975eeb67a2025bef2ed403 2023-10-02 19:04:03,112 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696273443112"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696273443112"}]},"ts":"1696273443112"} 2023-10-02 19:04:03,112 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=8d5d1261d4975eeb67a2025bef2ed403, regionState=CLOSED 2023-10-02 19:04:03,112 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696273443112"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696273443112"}]},"ts":"1696273443112"} 2023-10-02 19:04:03,114 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=101 2023-10-02 19:04:03,114 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure bbe0619123048c5d3e2e0bccb5b0eff9, server=jenkins-hbase20.apache.org,38887,1696273349229 in 169 msec 2023-10-02 19:04:03,115 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=100 2023-10-02 19:04:03,115 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 8d5d1261d4975eeb67a2025bef2ed403, server=jenkins-hbase20.apache.org,34425,1696273349187 in 170 msec 2023-10-02 19:04:03,115 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bbe0619123048c5d3e2e0bccb5b0eff9, UNASSIGN in 175 msec 2023-10-02 19:04:03,116 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=100, resume processing ppid=99 2023-10-02 19:04:03,116 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8d5d1261d4975eeb67a2025bef2ed403, UNASSIGN in 176 msec 2023-10-02 19:04:03,116 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696273443116"}]},"ts":"1696273443116"} 2023-10-02 19:04:03,117 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-10-02 19:04:03,118 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-10-02 19:04:03,120 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 186 msec 2023-10-02 19:04:03,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-02 19:04:03,240 INFO [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-10-02 19:04:03,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testEmptyExportFileSystemState 2023-10-02 19:04:03,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-02 19:04:03,246 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-02 19:04:03,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-10-02 19:04:03,247 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-02 19:04:03,250 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34425] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-10-02 19:04:03,251 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-02 19:04:03,251 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-02 19:04:03,251 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-02 19:04:03,251 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-02 19:04:03,252 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-02 19:04:03,252 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-02 19:04:03,252 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-02 19:04:03,252 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testEmptyExportFileSystemState/8d5d1261d4975eeb67a2025bef2ed403 2023-10-02 19:04:03,252 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testEmptyExportFileSystemState/bbe0619123048c5d3e2e0bccb5b0eff9 2023-10-02 19:04:03,252 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-02 19:04:03,252 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:04:03,252 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-10-02 19:04:03,252 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-02 19:04:03,252 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:04:03,252 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-02 19:04:03,252 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:04:03,252 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-02 19:04:03,252 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:04:03,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-02 19:04:03,254 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testEmptyExportFileSystemState/8d5d1261d4975eeb67a2025bef2ed403/cf, FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testEmptyExportFileSystemState/8d5d1261d4975eeb67a2025bef2ed403/recovered.edits] 2023-10-02 19:04:03,254 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testEmptyExportFileSystemState/bbe0619123048c5d3e2e0bccb5b0eff9/cf, FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testEmptyExportFileSystemState/bbe0619123048c5d3e2e0bccb5b0eff9/recovered.edits] 2023-10-02 19:04:03,257 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testEmptyExportFileSystemState/bbe0619123048c5d3e2e0bccb5b0eff9/cf/dd8af99397e745149b4bda758e81981c to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testEmptyExportFileSystemState/bbe0619123048c5d3e2e0bccb5b0eff9/cf/dd8af99397e745149b4bda758e81981c 2023-10-02 19:04:03,257 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testEmptyExportFileSystemState/8d5d1261d4975eeb67a2025bef2ed403/cf/94699414102d40a898d6d3ee4b08ab0f to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testEmptyExportFileSystemState/8d5d1261d4975eeb67a2025bef2ed403/cf/94699414102d40a898d6d3ee4b08ab0f 2023-10-02 19:04:03,260 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testEmptyExportFileSystemState/8d5d1261d4975eeb67a2025bef2ed403/recovered.edits/9.seqid to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testEmptyExportFileSystemState/8d5d1261d4975eeb67a2025bef2ed403/recovered.edits/9.seqid 2023-10-02 19:04:03,260 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testEmptyExportFileSystemState/bbe0619123048c5d3e2e0bccb5b0eff9/recovered.edits/9.seqid to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testEmptyExportFileSystemState/bbe0619123048c5d3e2e0bccb5b0eff9/recovered.edits/9.seqid 2023-10-02 19:04:03,260 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testEmptyExportFileSystemState/8d5d1261d4975eeb67a2025bef2ed403 2023-10-02 19:04:03,261 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testEmptyExportFileSystemState/bbe0619123048c5d3e2e0bccb5b0eff9 2023-10-02 19:04:03,261 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-02 19:04:03,261 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-02 19:04:03,261 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-10-02 19:04:03,265 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310027174f2d6f73242f7b028043172fbd595 to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310027174f2d6f73242f7b028043172fbd595 2023-10-02 19:04:03,266 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310023c9022817f1542d3907dacbd96f17cff to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310023c9022817f1542d3907dacbd96f17cff 2023-10-02 19:04:03,267 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-02 19:04:03,269 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-02 19:04:03,271 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-10-02 19:04:03,273 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-10-02 19:04:03,274 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-02 19:04:03,274 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-10-02 19:04:03,274 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696273443274"}]},"ts":"9223372036854775807"} 2023-10-02 19:04:03,274 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696273443274"}]},"ts":"9223372036854775807"} 2023-10-02 19:04:03,276 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-02 19:04:03,276 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8d5d1261d4975eeb67a2025bef2ed403, NAME => 'testtb-testEmptyExportFileSystemState,,1696273433050.8d5d1261d4975eeb67a2025bef2ed403.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => bbe0619123048c5d3e2e0bccb5b0eff9, NAME => 'testtb-testEmptyExportFileSystemState,1,1696273433050.bbe0619123048c5d3e2e0bccb5b0eff9.', STARTKEY => '1', ENDKEY => ''}] 2023-10-02 19:04:03,277 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-10-02 19:04:03,277 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696273443277"}]},"ts":"9223372036854775807"} 2023-10-02 19:04:03,279 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-10-02 19:04:03,280 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-02 19:04:03,281 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 39 msec 2023-10-02 19:04:03,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-02 19:04:03,354 INFO [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-10-02 19:04:03,360 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-10-02 19:04:03,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 19:04:03,363 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-10-02 19:04:03,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-10-02 19:04:03,385 INFO [Listener at jenkins-hbase20.apache.org/42825] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 763) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-460009722_1 at /127.0.0.1:40770 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb2bac33-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1470868269) connection to jenkins-hbase20.apache.org/148.251.75.209:44037 from appattempt_1696273355352_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0xb2bac33-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1470868269) connection to jenkins-hbase20.apache.org/148.251.75.209:40063 from appattempt_1696273355352_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-460009722_1 at /127.0.0.1:38866 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4847 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1557508828_17 at /127.0.0.1:56444 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb2bac33-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1470868269) connection to jenkins-hbase20.apache.org/148.251.75.209:37639 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0xb2bac33-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1557508828_17 at /127.0.0.1:43874 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=943 (was 924) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=250 (was 234) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 169), AvailableMemoryMB=4427 (was 4486) 2023-10-02 19:04:03,385 WARN [Listener at jenkins-hbase20.apache.org/42825] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-02 19:04:03,403 INFO [Listener at jenkins-hbase20.apache.org/42825] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=943, MaxFileDescriptor=60000, SystemLoadAverage=250, ProcessCount=168, AvailableMemoryMB=4427 2023-10-02 19:04:03,403 WARN [Listener at jenkins-hbase20.apache.org/42825] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-02 19:04:03,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-02 19:04:03,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:03,407 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 19:04:03,407 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-10-02 19:04:03,407 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 19:04:03,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-02 19:04:03,409 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/aac34b78cb466691db715ab5f7c97d28 2023-10-02 19:04:03,409 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b4e6a46146ff64e6856c8617d4369550 2023-10-02 19:04:03,410 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/aac34b78cb466691db715ab5f7c97d28 empty. 2023-10-02 19:04:03,410 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b4e6a46146ff64e6856c8617d4369550 empty. 2023-10-02 19:04:03,410 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/aac34b78cb466691db715ab5f7c97d28 2023-10-02 19:04:03,410 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b4e6a46146ff64e6856c8617d4369550 2023-10-02 19:04:03,410 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-02 19:04:03,418 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-10-02 19:04:03,419 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => b4e6a46146ff64e6856c8617d4369550, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp 2023-10-02 19:04:03,419 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => aac34b78cb466691db715ab5f7c97d28, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp 2023-10-02 19:04:03,434 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:04:03,434 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:04:03,434 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing aac34b78cb466691db715ab5f7c97d28, disabling compactions & flushes 2023-10-02 19:04:03,434 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing b4e6a46146ff64e6856c8617d4369550, disabling compactions & flushes 2023-10-02 19:04:03,434 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28. 2023-10-02 19:04:03,434 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550. 2023-10-02 19:04:03,434 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28. 2023-10-02 19:04:03,434 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550. 2023-10-02 19:04:03,434 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28. after waiting 0 ms 2023-10-02 19:04:03,434 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550. after waiting 0 ms 2023-10-02 19:04:03,434 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28. 2023-10-02 19:04:03,434 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550. 2023-10-02 19:04:03,434 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28. 2023-10-02 19:04:03,434 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550. 2023-10-02 19:04:03,434 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for aac34b78cb466691db715ab5f7c97d28: 2023-10-02 19:04:03,435 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for b4e6a46146ff64e6856c8617d4369550: 2023-10-02 19:04:03,437 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 19:04:03,437 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696273443437"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696273443437"}]},"ts":"1696273443437"} 2023-10-02 19:04:03,437 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696273443437"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696273443437"}]},"ts":"1696273443437"} 2023-10-02 19:04:03,439 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-02 19:04:03,440 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 19:04:03,440 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696273443440"}]},"ts":"1696273443440"} 2023-10-02 19:04:03,441 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-10-02 19:04:03,443 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-10-02 19:04:03,444 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 19:04:03,444 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 19:04:03,444 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 19:04:03,444 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 19:04:03,444 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=aac34b78cb466691db715ab5f7c97d28, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b4e6a46146ff64e6856c8617d4369550, ASSIGN}] 2023-10-02 19:04:03,446 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b4e6a46146ff64e6856c8617d4369550, ASSIGN 2023-10-02 19:04:03,446 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=aac34b78cb466691db715ab5f7c97d28, ASSIGN 2023-10-02 19:04:03,447 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b4e6a46146ff64e6856c8617d4369550, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,32897,1696273349258; forceNewPlan=false, retain=false 2023-10-02 19:04:03,447 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=aac34b78cb466691db715ab5f7c97d28, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38887,1696273349229; forceNewPlan=false, retain=false 2023-10-02 19:04:03,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-02 19:04:03,597 INFO [jenkins-hbase20:32777] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-02 19:04:03,600 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=b4e6a46146ff64e6856c8617d4369550, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:03,600 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=aac34b78cb466691db715ab5f7c97d28, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:03,600 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696273443600"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696273443600"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696273443600"}]},"ts":"1696273443600"} 2023-10-02 19:04:03,600 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696273443600"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696273443600"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696273443600"}]},"ts":"1696273443600"} 2023-10-02 19:04:03,602 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure b4e6a46146ff64e6856c8617d4369550, server=jenkins-hbase20.apache.org,32897,1696273349258}] 2023-10-02 19:04:03,602 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure aac34b78cb466691db715ab5f7c97d28, server=jenkins-hbase20.apache.org,38887,1696273349229}] 2023-10-02 19:04:03,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-02 19:04:03,756 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28. 2023-10-02 19:04:03,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => aac34b78cb466691db715ab5f7c97d28, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28.', STARTKEY => '', ENDKEY => '1'} 2023-10-02 19:04:03,756 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550. 2023-10-02 19:04:03,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b4e6a46146ff64e6856c8617d4369550, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550.', STARTKEY => '1', ENDKEY => ''} 2023-10-02 19:04:03,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28. service=AccessControlService 2023-10-02 19:04:03,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550. service=AccessControlService 2023-10-02 19:04:03,756 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 19:04:03,756 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 19:04:03,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp aac34b78cb466691db715ab5f7c97d28 2023-10-02 19:04:03,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp b4e6a46146ff64e6856c8617d4369550 2023-10-02 19:04:03,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:04:03,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 19:04:03,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for aac34b78cb466691db715ab5f7c97d28 2023-10-02 19:04:03,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for b4e6a46146ff64e6856c8617d4369550 2023-10-02 19:04:03,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for aac34b78cb466691db715ab5f7c97d28 2023-10-02 19:04:03,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for b4e6a46146ff64e6856c8617d4369550 2023-10-02 19:04:03,758 INFO [StoreOpener-b4e6a46146ff64e6856c8617d4369550-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b4e6a46146ff64e6856c8617d4369550 2023-10-02 19:04:03,758 INFO [StoreOpener-aac34b78cb466691db715ab5f7c97d28-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region aac34b78cb466691db715ab5f7c97d28 2023-10-02 19:04:03,759 DEBUG [StoreOpener-b4e6a46146ff64e6856c8617d4369550-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithSkipTmp/b4e6a46146ff64e6856c8617d4369550/cf 2023-10-02 19:04:03,759 DEBUG [StoreOpener-b4e6a46146ff64e6856c8617d4369550-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithSkipTmp/b4e6a46146ff64e6856c8617d4369550/cf 2023-10-02 19:04:03,759 DEBUG [StoreOpener-aac34b78cb466691db715ab5f7c97d28-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithSkipTmp/aac34b78cb466691db715ab5f7c97d28/cf 2023-10-02 19:04:03,759 DEBUG [StoreOpener-aac34b78cb466691db715ab5f7c97d28-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithSkipTmp/aac34b78cb466691db715ab5f7c97d28/cf 2023-10-02 19:04:03,759 INFO [StoreOpener-aac34b78cb466691db715ab5f7c97d28-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aac34b78cb466691db715ab5f7c97d28 columnFamilyName cf 2023-10-02 19:04:03,759 INFO [StoreOpener-b4e6a46146ff64e6856c8617d4369550-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b4e6a46146ff64e6856c8617d4369550 columnFamilyName cf 2023-10-02 19:04:03,760 INFO [StoreOpener-b4e6a46146ff64e6856c8617d4369550-1] regionserver.HStore(310): Store=b4e6a46146ff64e6856c8617d4369550/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 19:04:03,760 INFO [StoreOpener-aac34b78cb466691db715ab5f7c97d28-1] regionserver.HStore(310): Store=aac34b78cb466691db715ab5f7c97d28/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 19:04:03,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithSkipTmp/aac34b78cb466691db715ab5f7c97d28 2023-10-02 19:04:03,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithSkipTmp/b4e6a46146ff64e6856c8617d4369550 2023-10-02 19:04:03,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithSkipTmp/aac34b78cb466691db715ab5f7c97d28 2023-10-02 19:04:03,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithSkipTmp/b4e6a46146ff64e6856c8617d4369550 2023-10-02 19:04:03,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for b4e6a46146ff64e6856c8617d4369550 2023-10-02 19:04:03,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for aac34b78cb466691db715ab5f7c97d28 2023-10-02 19:04:03,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithSkipTmp/b4e6a46146ff64e6856c8617d4369550/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 19:04:03,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithSkipTmp/aac34b78cb466691db715ab5f7c97d28/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 19:04:03,771 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened b4e6a46146ff64e6856c8617d4369550; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64456785, jitterRate=-0.0395190566778183}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 19:04:03,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for b4e6a46146ff64e6856c8617d4369550: 2023-10-02 19:04:03,771 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened aac34b78cb466691db715ab5f7c97d28; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70175064, jitterRate=0.045689940452575684}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 19:04:03,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for aac34b78cb466691db715ab5f7c97d28: 2023-10-02 19:04:03,772 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550., pid=108, masterSystemTime=1696273443753 2023-10-02 19:04:03,772 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28., pid=109, masterSystemTime=1696273443753 2023-10-02 19:04:03,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550. 2023-10-02 19:04:03,773 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550. 2023-10-02 19:04:03,773 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=b4e6a46146ff64e6856c8617d4369550, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:03,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28. 2023-10-02 19:04:03,773 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28. 2023-10-02 19:04:03,773 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696273443773"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696273443773"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696273443773"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696273443773"}]},"ts":"1696273443773"} 2023-10-02 19:04:03,774 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=aac34b78cb466691db715ab5f7c97d28, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:03,774 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696273443774"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696273443774"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696273443774"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696273443774"}]},"ts":"1696273443774"} 2023-10-02 19:04:03,776 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=107 2023-10-02 19:04:03,776 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure b4e6a46146ff64e6856c8617d4369550, server=jenkins-hbase20.apache.org,32897,1696273349258 in 173 msec 2023-10-02 19:04:03,777 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-10-02 19:04:03,777 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure aac34b78cb466691db715ab5f7c97d28, server=jenkins-hbase20.apache.org,38887,1696273349229 in 173 msec 2023-10-02 19:04:03,777 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b4e6a46146ff64e6856c8617d4369550, ASSIGN in 332 msec 2023-10-02 19:04:03,779 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=106, resume processing ppid=105 2023-10-02 19:04:03,779 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=aac34b78cb466691db715ab5f7c97d28, ASSIGN in 333 msec 2023-10-02 19:04:03,780 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 19:04:03,780 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696273443780"}]},"ts":"1696273443780"} 2023-10-02 19:04:03,781 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-10-02 19:04:03,783 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 19:04:03,783 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-10-02 19:04:03,784 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34425] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-02 19:04:03,785 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:04:03,786 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:04:03,786 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:04:03,785 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:04:03,787 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-02 19:04:03,787 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-02 19:04:03,787 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-02 19:04:03,787 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-02 19:04:03,788 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 382 msec 2023-10-02 19:04:04,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-02 19:04:04,012 INFO [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-10-02 19:04:04,015 DEBUG [Listener at jenkins-hbase20.apache.org/42825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,016 DEBUG [Listener at jenkins-hbase20.apache.org/42825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28. 2023-10-02 19:04:04,019 INFO [Listener at jenkins-hbase20.apache.org/42825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 19:04:04,034 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-02 19:04:04,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696273444034 (current time:1696273444034). 2023-10-02 19:04:04,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 19:04:04,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(139): Connect 0x3535ffd6 to 127.0.0.1:60248 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 19:04:04,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8bed15c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 19:04:04,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:04:04,046 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55718, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:04:04,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3535ffd6 to 127.0.0.1:60248 2023-10-02 19:04:04,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:04:04,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(139): Connect 0x1805fb29 to 127.0.0.1:60248 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 19:04:04,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d46cb0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 19:04:04,059 DEBUG [hconnection-0x7c1e7987-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:04:04,063 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55734, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:04:04,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:04:04,071 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57758, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:04:04,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1805fb29 to 127.0.0.1:60248 2023-10-02 19:04:04,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:04:04,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-02 19:04:04,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 19:04:04,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-02 19:04:04,077 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot, current working dir path: hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 19:04:04,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-02 19:04:04,079 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-02 19:04:04,079 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696274044079 2023-10-02 19:04:04,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-02 19:04:04,079 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,081 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 19:04:04,081 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 19:04:04,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-02 19:04:04,082 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-02 19:04:04,084 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-10-02 19:04:04,085 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-02 19:04:04,085 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696274044085 2023-10-02 19:04:04,097 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,097 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-02 19:04:04,097 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:04:04,099 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-02 19:04:04,099 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-02 19:04:04,099 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,099 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,102 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:04:04,102 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:04:04,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:04:04,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:04:04,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:04:04,102 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:04:04,102 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:04:04,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:04:04,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:04:04,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,102 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,103 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,103 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,103 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,103 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 19:04:04,103 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,103 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-02 19:04:04,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-02 19:04:04,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,103 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-02 19:04:04,103 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-02 19:04:04,104 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,104 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-02 19:04:04,104 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:04:04,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-02 19:04:04,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,105 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-02 19:04:04,106 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,108 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,108 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-02 19:04:04,108 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-02 19:04:04,108 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-02 19:04:04,108 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:04:04,108 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:04:04,109 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-02 19:04:04,111 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-02 19:04:04,111 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,32897,1696273349258' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-02 19:04:04,108 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-02 19:04:04,111 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34425,1696273349187' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-02 19:04:04,111 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-02 19:04:04,111 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-02 19:04:04,111 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38887,1696273349229' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-02 19:04:04,120 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,123 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,123 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,123 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,123 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:04:04,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:04:04,123 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:04:04,123 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,123 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,123 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,124 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:04:04,124 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:04:04,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:04:04,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:04:04,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:04:04,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:04:04,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38887,1696273349229' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-02 19:04:04,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e9a3662[Count = 1] remaining members to acquire global barrier 2023-10-02 19:04:04,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:04:04,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:04:04,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:04:04,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:04:04,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:04:04,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:04:04,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,32897,1696273349258' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-02 19:04:04,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e9a3662[Count = 0] remaining members to acquire global barrier 2023-10-02 19:04:04,127 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-02 19:04:04,127 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,129 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,129 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,129 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,129 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-02 19:04:04,129 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,129 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-02 19:04:04,129 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 19:04:04,129 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 19:04:04,129 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550. 2023-10-02 19:04:04,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,129 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28. 2023-10-02 19:04:04,129 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550. started... 2023-10-02 19:04:04,129 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 19:04:04,130 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 19:04:04,129 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,131 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b4e6a46146ff64e6856c8617d4369550: 2023-10-02 19:04:04,131 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 19:04:04,129 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28. started... 2023-10-02 19:04:04,129 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-02 19:04:04,131 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,131 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-02 19:04:04,131 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for aac34b78cb466691db715ab5f7c97d28: 2023-10-02 19:04:04,131 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,34425,1696273349187' in zk 2023-10-02 19:04:04,131 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 19:04:04,131 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,131 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 19:04:04,131 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 19:04:04,131 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 19:04:04,132 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-02 19:04:04,132 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:04:04,132 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-02 19:04:04,148 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550. completed. 2023-10-02 19:04:04,148 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550. 2023-10-02 19:04:04,148 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 19:04:04,149 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 19:04:04,149 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,149 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-02 19:04:04,149 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,32897,1696273349258' in zk 2023-10-02 19:04:04,150 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-02 19:04:04,150 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,150 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:04:04,150 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-02 19:04:04,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:04:04,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:04:04,152 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28. completed. 2023-10-02 19:04:04,152 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28. 2023-10-02 19:04:04,152 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 19:04:04,152 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 19:04:04,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:04:04,152 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,152 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-02 19:04:04,152 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,38887,1696273349229' in zk 2023-10-02 19:04:04,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:04:04,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,153 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,153 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-02 19:04:04,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,153 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:04:04,153 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-02 19:04:04,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:04:04,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:04:04,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:04:04,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,32897,1696273349258': 2023-10-02 19:04:04,156 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,32897,1696273349258' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-02 19:04:04,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:04:04,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:04:04,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:04:04,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:04:04,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:04:04,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:04:04,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:04:04,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,38887,1696273349229': 2023-10-02 19:04:04,161 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38887,1696273349229' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-02 19:04:04,161 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-02 19:04:04,161 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 19:04:04,161 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 19:04:04,161 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,161 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 19:04:04,164 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,164 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:04:04,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:04:04,164 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,164 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,165 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:04:04,165 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:04:04,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,164 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:04:04,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:04:04,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:04:04,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:04:04,165 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:04:04,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:04:04,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:04:04,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:04:04,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,165 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:04:04,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,166 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:04:04,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:04:04,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:04:04,167 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,167 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,167 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:04:04,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:04:04,170 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:04:04,170 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,171 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:04:04,171 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:04:04,171 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:04:04,171 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,171 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:04:04,171 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,171 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,171 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,171 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:04:04,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:04:04,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:04:04,171 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:04:04,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:04:04,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:04:04,171 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,171 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:04:04,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:04:04,171 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:04:04,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:04:04,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:04:04,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:04:04,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:04:04,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:04:04,172 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:04:04,172 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 19:04:04,173 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:04:04,173 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,173 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,173 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,173 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,173 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-02 19:04:04,179 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,180 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,181 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 19:04:04,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-02 19:04:04,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-02 19:04:04,182 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 19:04:04,196 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,196 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-02 19:04:04,196 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,197 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,197 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696273444080Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696273444179 (+99 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696273444179Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696273444179Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696273444182 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696273444191 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696273444196 (+5 ms) 2023-10-02 19:04:04,199 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-02 19:04:04,200 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 118 msec 2023-10-02 19:04:04,383 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 19:04:04,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-02 19:04:04,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 19:04:04,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38887] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 19:04:04,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32897] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 19:04:04,399 DEBUG [Listener at jenkins-hbase20.apache.org/42825] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,399 DEBUG [Listener at jenkins-hbase20.apache.org/42825] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28. 2023-10-02 19:04:04,399 INFO [Listener at jenkins-hbase20.apache.org/42825] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 19:04:04,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-02 19:04:04,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696273444408 (current time:1696273444408). 2023-10-02 19:04:04,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 19:04:04,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(139): Connect 0x1883bbd6 to 127.0.0.1:60248 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 19:04:04,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@140c7894, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 19:04:04,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:04:04,415 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55738, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:04:04,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1883bbd6 to 127.0.0.1:60248 2023-10-02 19:04:04,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:04:04,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(139): Connect 0x775b2c2e to 127.0.0.1:60248 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 19:04:04,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72836418, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 19:04:04,423 DEBUG [hconnection-0x5bc7a04-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:04:04,435 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55740, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:04:04,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 19:04:04,443 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57770, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 19:04:04,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x775b2c2e to 127.0.0.1:60248 2023-10-02 19:04:04,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:04:04,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-02 19:04:04,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 19:04:04,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-02 19:04:04,448 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot, current working dir path: hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 19:04:04,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-02 19:04:04,450 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-02 19:04:04,451 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696274044451 2023-10-02 19:04:04,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-02 19:04:04,451 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,453 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 19:04:04,453 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 19:04:04,454 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-02 19:04:04,454 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-02 19:04:04,455 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-10-02 19:04:04,456 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-02 19:04:04,456 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696274044456 2023-10-02 19:04:04,467 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,467 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-02 19:04:04,467 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:04:04,468 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-02 19:04:04,468 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-02 19:04:04,469 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,469 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,470 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:04:04,470 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:04:04,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:04:04,470 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,470 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:04:04,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:04:04,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:04:04,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:04:04,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:04:04,470 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:04:04,470 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,470 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,470 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 19:04:04,470 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,470 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,471 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-02 19:04:04,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-02 19:04:04,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-02 19:04:04,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,471 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-02 19:04:04,471 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-02 19:04:04,471 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-02 19:04:04,471 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,471 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,471 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-02 19:04:04,471 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-02 19:04:04,471 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:04:04,471 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,472 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-02 19:04:04,472 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-02 19:04:04,472 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:04:04,471 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 19:04:04,473 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-02 19:04:04,473 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-02 19:04:04,472 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-02 19:04:04,473 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38887,1696273349229' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-02 19:04:04,473 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34425,1696273349187' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-02 19:04:04,473 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-02 19:04:04,474 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-02 19:04:04,474 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,32897,1696273349258' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-02 19:04:04,474 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,475 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,475 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,475 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,476 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:04:04,475 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:04:04,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:04:04,475 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,476 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,476 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:04:04,476 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,476 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 19:04:04,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:04:04,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:04:04,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:04:04,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:04:04,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38887,1696273349229' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-02 19:04:04,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20acafb[Count = 1] remaining members to acquire global barrier 2023-10-02 19:04:04,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:04:04,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:04:04,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:04:04,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:04:04,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:04:04,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:04:04,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,32897,1696273349258' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-02 19:04:04,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20acafb[Count = 0] remaining members to acquire global barrier 2023-10-02 19:04:04,479 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-02 19:04:04,479 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,479 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,480 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,480 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,480 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-02 19:04:04,480 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,480 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-02 19:04:04,480 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 19:04:04,480 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 19:04:04,480 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-02 19:04:04,480 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28. 2023-10-02 19:04:04,480 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 19:04:04,480 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 19:04:04,480 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550. 2023-10-02 19:04:04,480 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28. started... 2023-10-02 19:04:04,480 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,480 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 19:04:04,480 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-02 19:04:04,480 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550. started... 2023-10-02 19:04:04,480 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,34425,1696273349187' in zk 2023-10-02 19:04:04,480 INFO [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] regionserver.HRegion(2745): Flushing aac34b78cb466691db715ab5f7c97d28 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-10-02 19:04:04,481 INFO [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b4e6a46146ff64e6856c8617d4369550 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-10-02 19:04:04,482 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-02 19:04:04,482 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:04:04,482 DEBUG [member: 'jenkins-hbase20.apache.org,34425,1696273349187' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-02 19:04:04,503 INFO [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231002d84d15df57de465bb00e9f8d515508ed to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20231002d84d15df57de465bb00e9f8d515508ed 2023-10-02 19:04:04,503 INFO [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231002fa90243b7d5e4b389884931f0e43584a to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231002fa90243b7d5e4b389884931f0e43584a 2023-10-02 19:04:04,514 INFO [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithSkipTmp/aac34b78cb466691db715ab5f7c97d28/.tmp/cf/625714136aba421d8df8dc0a00922642 2023-10-02 19:04:04,521 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithSkipTmp/aac34b78cb466691db715ab5f7c97d28/.tmp/cf/625714136aba421d8df8dc0a00922642 as hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithSkipTmp/aac34b78cb466691db715ab5f7c97d28/cf/625714136aba421d8df8dc0a00922642 2023-10-02 19:04:04,525 INFO [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithSkipTmp/aac34b78cb466691db715ab5f7c97d28/cf/625714136aba421d8df8dc0a00922642, entries=6, sequenceid=6, filesize=6.0 K 2023-10-02 19:04:04,527 INFO [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for aac34b78cb466691db715ab5f7c97d28 in 47ms, sequenceid=6, compaction requested=false 2023-10-02 19:04:04,528 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-10-02 19:04:04,528 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for aac34b78cb466691db715ab5f7c97d28: 2023-10-02 19:04:04,528 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,528 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 19:04:04,528 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithSkipTmp/aac34b78cb466691db715ab5f7c97d28/cf/625714136aba421d8df8dc0a00922642] hfiles 2023-10-02 19:04:04,529 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithSkipTmp/aac34b78cb466691db715ab5f7c97d28/cf/625714136aba421d8df8dc0a00922642 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,530 INFO [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithSkipTmp/b4e6a46146ff64e6856c8617d4369550/.tmp/cf/969d6dc478b74d6dbe85f57df8298d49 2023-10-02 19:04:04,534 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithSkipTmp/b4e6a46146ff64e6856c8617d4369550/.tmp/cf/969d6dc478b74d6dbe85f57df8298d49 as hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithSkipTmp/b4e6a46146ff64e6856c8617d4369550/cf/969d6dc478b74d6dbe85f57df8298d49 2023-10-02 19:04:04,538 INFO [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithSkipTmp/b4e6a46146ff64e6856c8617d4369550/cf/969d6dc478b74d6dbe85f57df8298d49, entries=44, sequenceid=6, filesize=12.8 K 2023-10-02 19:04:04,539 INFO [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for b4e6a46146ff64e6856c8617d4369550 in 59ms, sequenceid=6, compaction requested=false 2023-10-02 19:04:04,540 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b4e6a46146ff64e6856c8617d4369550: 2023-10-02 19:04:04,540 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,540 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 19:04:04,541 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithSkipTmp/b4e6a46146ff64e6856c8617d4369550/cf/969d6dc478b74d6dbe85f57df8298d49] hfiles 2023-10-02 19:04:04,541 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithSkipTmp/b4e6a46146ff64e6856c8617d4369550/cf/969d6dc478b74d6dbe85f57df8298d49 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,541 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28. completed. 2023-10-02 19:04:04,541 DEBUG [rs(jenkins-hbase20.apache.org,38887,1696273349229)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28. 2023-10-02 19:04:04,541 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 19:04:04,541 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 19:04:04,541 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,541 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-02 19:04:04,541 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,38887,1696273349229' in zk 2023-10-02 19:04:04,542 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,542 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-02 19:04:04,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:04:04,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:04:04,542 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:04:04,542 DEBUG [member: 'jenkins-hbase20.apache.org,38887,1696273349229' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-02 19:04:04,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:04:04,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:04:04,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:04:04,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:04:04,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:04:04,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,38887,1696273349229': 2023-10-02 19:04:04,546 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38887,1696273349229' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-02 19:04:04,548 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550. completed. 2023-10-02 19:04:04,548 DEBUG [rs(jenkins-hbase20.apache.org,32897,1696273349258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550. 2023-10-02 19:04:04,548 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 19:04:04,548 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 19:04:04,548 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,548 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-02 19:04:04,548 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,32897,1696273349258' in zk 2023-10-02 19:04:04,553 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 19:04:04,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-02 19:04:04,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-02 19:04:04,554 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,554 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-02 19:04:04,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:04:04,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:04:04,554 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 19:04:04,554 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:04:04,554 DEBUG [member: 'jenkins-hbase20.apache.org,32897,1696273349258' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-02 19:04:04,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:04:04,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:04:04,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:04:04,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:04:04,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:04:04,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,32897,1696273349258': 2023-10-02 19:04:04,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,32897,1696273349258' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-02 19:04:04,559 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-02 19:04:04,559 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 19:04:04,559 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 19:04:04,559 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,559 INFO [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 19:04:04,564 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,564 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,564 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,564 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 19:04:04,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 19:04:04,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,565 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:04:04,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,564 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:04:04,564 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:04:04,565 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 19:04:04,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:04:04,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:04:04,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:04:04,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:04:04,566 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:04:04,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:04:04,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,566 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:04:04,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 19:04:04,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:04:04,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 19:04:04,568 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,569 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,569 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:04:04,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:04:04,572 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:04:04,572 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:04:04,573 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:04:04,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:04:04,573 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 19:04:04,573 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:04:04,573 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:04:04,573 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,573 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:04:04,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:04:04,573 DEBUG [(jenkins-hbase20.apache.org,32777,1696273348175)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 19:04:04,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:04:04,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 19:04:04,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 19:04:04,573 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 19:04:04,573 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:04:04,575 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,573 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,575 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 19:04:04,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:04:04,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:04:04,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:04:04,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 19:04:04,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 19:04:04,576 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,576 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,576 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:04:04,576 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,576 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:04,576 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:04,576 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,576 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20231002d84d15df57de465bb00e9f8d515508ed, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231002fa90243b7d5e4b389884931f0e43584a] mob files 2023-10-02 19:04:04,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20231002d84d15df57de465bb00e9f8d515508ed 2023-10-02 19:04:04,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231002fa90243b7d5e4b389884931f0e43584a 2023-10-02 19:04:04,585 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,585 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,600 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,601 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-02 19:04:04,601 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,602 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,602 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696273444451Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696273444585 (+134 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696273444585Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1696273444585Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1696273444587 (+2 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696273444593 (+6 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696273444601 (+8 ms) 2023-10-02 19:04:04,604 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-02 19:04:04,605 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 152 msec 2023-10-02 19:04:04,754 DEBUG [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 19:04:04,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-02 19:04:04,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 19:04:04,758 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273444758 2023-10-02 19:04:04,758 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46307, tgtDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273444758, rawTgtDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273444758, srcFsUri=hdfs://localhost:46307, srcDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6 2023-10-02 19:04:04,782 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46307, inputRoot=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6 2023-10-02 19:04:04,782 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-579982249_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273444758, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273444758/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,782 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46307, inputRoot=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6, snapshotDir=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-10-02 19:04:04,792 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273444758/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:04,813 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-02 19:04:04,814 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-02 19:04:04,814 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-02 19:04:04,814 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-02 19:04:05,516 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/hadoop-6630972733894396563.jar 2023-10-02 19:04:05,517 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-02 19:04:05,517 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-02 19:04:05,570 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/hadoop-7576444724965481329.jar 2023-10-02 19:04:05,571 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-02 19:04:05,571 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-02 19:04:05,571 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-02 19:04:05,572 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-02 19:04:05,572 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-02 19:04:05,572 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-02 19:04:05,573 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-02 19:04:05,573 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-02 19:04:05,573 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-02 19:04:05,573 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-02 19:04:05,574 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-02 19:04:05,574 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-02 19:04:05,574 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-02 19:04:05,575 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-02 19:04:05,575 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-02 19:04:05,575 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-02 19:04:05,576 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 19:04:05,576 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 19:04:05,576 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 19:04:05,577 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 19:04:05,577 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 19:04:05,577 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 19:04:05,577 DEBUG [Listener at jenkins-hbase20.apache.org/42825] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 19:04:05,937 WARN [Listener at jenkins-hbase20.apache.org/42825] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-02 19:04:05,939 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-10-02 19:04:05,941 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-10-02 19:04:07,438 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 19:04:07,439 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 19:04:07,440 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696273355352_0006_000001 (auth:SIMPLE) 2023-10-02 19:04:08,095 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696273355352_0007_000001 (auth:SIMPLE) 2023-10-02 19:04:08,696 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-02 19:04:11,465 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696273355352_0007_000001 (auth:SIMPLE) 2023-10-02 19:04:13,673 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696273355352_0007_000001 (auth:SIMPLE) 2023-10-02 19:04:15,827 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696273355352_0007_000001 (auth:SIMPLE) 2023-10-02 19:04:17,123 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-02 19:04:17,123 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-02 19:04:17,131 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:17,131 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-02 19:04:17,132 INFO [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-02 19:04:17,132 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1557508828_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:17,132 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(367): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-02 19:04:17,132 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(367): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-02 19:04:17,132 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1557508828_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273444758/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273444758/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:17,133 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(367): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273444758/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-02 19:04:17,133 DEBUG [Listener at jenkins-hbase20.apache.org/42825] snapshot.TestExportSnapshot(367): hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/export-test/export-1696273444758/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-02 19:04:17,139 INFO [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:17,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:17,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:17,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-02 19:04:17,143 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696273457143"}]},"ts":"1696273457143"} 2023-10-02 19:04:17,144 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-10-02 19:04:17,145 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-10-02 19:04:17,146 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=aac34b78cb466691db715ab5f7c97d28, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b4e6a46146ff64e6856c8617d4369550, UNASSIGN}] 2023-10-02 19:04:17,147 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b4e6a46146ff64e6856c8617d4369550, UNASSIGN 2023-10-02 19:04:17,148 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=aac34b78cb466691db715ab5f7c97d28, UNASSIGN 2023-10-02 19:04:17,149 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=b4e6a46146ff64e6856c8617d4369550, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:17,149 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=aac34b78cb466691db715ab5f7c97d28, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:17,149 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696273457149"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696273457149"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696273457149"}]},"ts":"1696273457149"} 2023-10-02 19:04:17,149 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696273457149"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696273457149"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696273457149"}]},"ts":"1696273457149"} 2023-10-02 19:04:17,150 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure aac34b78cb466691db715ab5f7c97d28, server=jenkins-hbase20.apache.org,38887,1696273349229}] 2023-10-02 19:04:17,151 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure b4e6a46146ff64e6856c8617d4369550, server=jenkins-hbase20.apache.org,32897,1696273349258}] 2023-10-02 19:04:17,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-02 19:04:17,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close aac34b78cb466691db715ab5f7c97d28 2023-10-02 19:04:17,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close b4e6a46146ff64e6856c8617d4369550 2023-10-02 19:04:17,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing aac34b78cb466691db715ab5f7c97d28, disabling compactions & flushes 2023-10-02 19:04:17,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28. 2023-10-02 19:04:17,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing b4e6a46146ff64e6856c8617d4369550, disabling compactions & flushes 2023-10-02 19:04:17,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550. 2023-10-02 19:04:17,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550. 2023-10-02 19:04:17,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28. 2023-10-02 19:04:17,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28. after waiting 0 ms 2023-10-02 19:04:17,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28. 2023-10-02 19:04:17,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550. after waiting 0 ms 2023-10-02 19:04:17,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550. 2023-10-02 19:04:17,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithSkipTmp/aac34b78cb466691db715ab5f7c97d28/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 19:04:17,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/default/testtb-testExportFileSystemStateWithSkipTmp/b4e6a46146ff64e6856c8617d4369550/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 19:04:17,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 19:04:17,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 19:04:17,323 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28. 2023-10-02 19:04:17,324 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550. 2023-10-02 19:04:17,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for aac34b78cb466691db715ab5f7c97d28: 2023-10-02 19:04:17,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for b4e6a46146ff64e6856c8617d4369550: 2023-10-02 19:04:17,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed aac34b78cb466691db715ab5f7c97d28 2023-10-02 19:04:17,326 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=aac34b78cb466691db715ab5f7c97d28, regionState=CLOSED 2023-10-02 19:04:17,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed b4e6a46146ff64e6856c8617d4369550 2023-10-02 19:04:17,326 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696273457326"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696273457326"}]},"ts":"1696273457326"} 2023-10-02 19:04:17,326 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=b4e6a46146ff64e6856c8617d4369550, regionState=CLOSED 2023-10-02 19:04:17,326 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696273457326"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696273457326"}]},"ts":"1696273457326"} 2023-10-02 19:04:17,329 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-10-02 19:04:17,329 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure aac34b78cb466691db715ab5f7c97d28, server=jenkins-hbase20.apache.org,38887,1696273349229 in 177 msec 2023-10-02 19:04:17,329 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-10-02 19:04:17,329 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure b4e6a46146ff64e6856c8617d4369550, server=jenkins-hbase20.apache.org,32897,1696273349258 in 177 msec 2023-10-02 19:04:17,330 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=aac34b78cb466691db715ab5f7c97d28, UNASSIGN in 183 msec 2023-10-02 19:04:17,331 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-10-02 19:04:17,331 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b4e6a46146ff64e6856c8617d4369550, UNASSIGN in 183 msec 2023-10-02 19:04:17,331 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696273457331"}]},"ts":"1696273457331"} 2023-10-02 19:04:17,332 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-10-02 19:04:17,333 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-10-02 19:04:17,335 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 194 msec 2023-10-02 19:04:17,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-02 19:04:17,447 INFO [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-10-02 19:04:17,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:17,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:17,453 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:17,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:17,454 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:17,455 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34425] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:17,457 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:17,457 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:17,457 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:17,458 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:17,458 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-02 19:04:17,458 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-02 19:04:17,459 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-02 19:04:17,459 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-02 19:04:17,459 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:17,459 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:17,459 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:04:17,459 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:17,459 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:17,459 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:04:17,460 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:04:17,460 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 19:04:17,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-02 19:04:17,461 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/aac34b78cb466691db715ab5f7c97d28 2023-10-02 19:04:17,461 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b4e6a46146ff64e6856c8617d4369550 2023-10-02 19:04:17,463 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/aac34b78cb466691db715ab5f7c97d28/cf, FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/aac34b78cb466691db715ab5f7c97d28/recovered.edits] 2023-10-02 19:04:17,464 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b4e6a46146ff64e6856c8617d4369550/cf, FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b4e6a46146ff64e6856c8617d4369550/recovered.edits] 2023-10-02 19:04:17,467 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/aac34b78cb466691db715ab5f7c97d28/cf/625714136aba421d8df8dc0a00922642 to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/aac34b78cb466691db715ab5f7c97d28/cf/625714136aba421d8df8dc0a00922642 2023-10-02 19:04:17,467 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b4e6a46146ff64e6856c8617d4369550/cf/969d6dc478b74d6dbe85f57df8298d49 to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/b4e6a46146ff64e6856c8617d4369550/cf/969d6dc478b74d6dbe85f57df8298d49 2023-10-02 19:04:17,469 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/aac34b78cb466691db715ab5f7c97d28/recovered.edits/9.seqid to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/aac34b78cb466691db715ab5f7c97d28/recovered.edits/9.seqid 2023-10-02 19:04:17,469 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b4e6a46146ff64e6856c8617d4369550/recovered.edits/9.seqid to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/b4e6a46146ff64e6856c8617d4369550/recovered.edits/9.seqid 2023-10-02 19:04:17,469 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/aac34b78cb466691db715ab5f7c97d28 2023-10-02 19:04:17,469 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b4e6a46146ff64e6856c8617d4369550 2023-10-02 19:04:17,469 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-02 19:04:17,469 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-02 19:04:17,470 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-10-02 19:04:17,472 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20231002d84d15df57de465bb00e9f8d515508ed to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20231002d84d15df57de465bb00e9f8d515508ed 2023-10-02 19:04:17,473 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231002fa90243b7d5e4b389884931f0e43584a to hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231002fa90243b7d5e4b389884931f0e43584a 2023-10-02 19:04:17,473 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-02 19:04:17,474 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:17,476 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-10-02 19:04:17,477 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-10-02 19:04:17,478 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:17,478 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-10-02 19:04:17,478 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696273457478"}]},"ts":"9223372036854775807"} 2023-10-02 19:04:17,478 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696273457478"}]},"ts":"9223372036854775807"} 2023-10-02 19:04:17,479 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-02 19:04:17,479 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => aac34b78cb466691db715ab5f7c97d28, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696273443404.aac34b78cb466691db715ab5f7c97d28.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b4e6a46146ff64e6856c8617d4369550, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696273443404.b4e6a46146ff64e6856c8617d4369550.', STARTKEY => '1', ENDKEY => ''}] 2023-10-02 19:04:17,479 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-10-02 19:04:17,480 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696273457479"}]},"ts":"9223372036854775807"} 2023-10-02 19:04:17,481 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-10-02 19:04:17,482 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:17,483 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 34 msec 2023-10-02 19:04:17,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-02 19:04:17,563 INFO [Listener at jenkins-hbase20.apache.org/42825] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-10-02 19:04:17,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-02 19:04:17,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:17,582 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-02 19:04:17,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32777] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 19:04:17,604 INFO [Listener at jenkins-hbase20.apache.org/42825] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=767 (was 765) Potentially hanging thread: hconnection-0xb2bac33-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1470868269) connection to jenkins-hbase20.apache.org/148.251.75.209:38267 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0xb2bac33-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb2bac33-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1470868269) connection to jenkins-hbase20.apache.org/148.251.75.209:40063 from appattempt_1696273355352_0007_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0xb2bac33-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-686542765_1 at /127.0.0.1:54172 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5453 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1557508828_17 at /127.0.0.1:54196 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1557508828_17 at /127.0.0.1:58560 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1557508828_17 at /127.0.0.1:34618 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-686542765_1 at /127.0.0.1:34598 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=915 (was 943), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=235 (was 250), ProcessCount=168 (was 168), AvailableMemoryMB=4344 (was 4427) 2023-10-02 19:04:17,604 WARN [Listener at jenkins-hbase20.apache.org/42825] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-10-02 19:04:17,604 INFO [Listener at jenkins-hbase20.apache.org/42825] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-10-02 19:04:17,615 INFO [Listener at jenkins-hbase20.apache.org/42825] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-10-02 19:04:17,730 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1696273355352_0007_01_000001 is : 143 2023-10-02 19:04:22,895 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-02 19:04:31,752 INFO [Listener at jenkins-hbase20.apache.org/42825] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-10-02 19:04:45,881 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-02 19:04:45,882 INFO [Listener at jenkins-hbase20.apache.org/42825] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-10-02 19:04:45,998 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-10-02 19:04:46,007 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-10-02 19:04:46,008 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-02 19:04:46,017 INFO [Listener at jenkins-hbase20.apache.org/42825] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-10-02 19:04:46,121 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-02 19:04:46,121 INFO [Listener at jenkins-hbase20.apache.org/42825] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-10-02 19:04:46,121 INFO [Listener at jenkins-hbase20.apache.org/42825] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-10-02 19:04:46,121 INFO [Listener at jenkins-hbase20.apache.org/42825] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-02 19:04:46,121 DEBUG [Listener at jenkins-hbase20.apache.org/42825] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x79e803a7 to 127.0.0.1:60248 2023-10-02 19:04:46,122 DEBUG [Listener at jenkins-hbase20.apache.org/42825] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:04:46,122 DEBUG [Listener at jenkins-hbase20.apache.org/42825] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-10-02 19:04:46,122 DEBUG [Listener at jenkins-hbase20.apache.org/42825] util.JVMClusterUtil(257): Found active master hash=1653259881, stopped=false 2023-10-02 19:04:46,123 DEBUG [Listener at jenkins-hbase20.apache.org/42825] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 19:04:46,123 DEBUG [Listener at jenkins-hbase20.apache.org/42825] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-02 19:04:46,124 INFO [Listener at jenkins-hbase20.apache.org/42825] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,32777,1696273348175 2023-10-02 19:04:46,125 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-02 19:04:46,125 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-02 19:04:46,126 INFO [Listener at jenkins-hbase20.apache.org/42825] procedure2.ProcedureExecutor(628): Stopping 2023-10-02 19:04:46,126 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-02 19:04:46,126 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-02 19:04:46,126 DEBUG [Listener at jenkins-hbase20.apache.org/42825] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x459c1dca to 127.0.0.1:60248 2023-10-02 19:04:46,126 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 19:04:46,127 DEBUG [Listener at jenkins-hbase20.apache.org/42825] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:04:46,126 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-02 19:04:46,127 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-02 19:04:46,127 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-02 19:04:46,127 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-02 19:04:46,127 INFO [Listener at jenkins-hbase20.apache.org/42825] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,34425,1696273349187' ***** 2023-10-02 19:04:46,128 DEBUG [Listener at jenkins-hbase20.apache.org/42825] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 19:04:46,128 INFO [Listener at jenkins-hbase20.apache.org/42825] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-02 19:04:46,128 INFO [Listener at jenkins-hbase20.apache.org/42825] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,38887,1696273349229' ***** 2023-10-02 19:04:46,128 INFO [RS:0;jenkins-hbase20:34425] regionserver.HeapMemoryManager(220): Stopping 2023-10-02 19:04:46,128 DEBUG [Listener at jenkins-hbase20.apache.org/42825] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 19:04:46,128 INFO [RS:0;jenkins-hbase20:34425] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-02 19:04:46,128 INFO [Listener at jenkins-hbase20.apache.org/42825] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-02 19:04:46,128 INFO [RS:0;jenkins-hbase20:34425] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-02 19:04:46,128 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-02 19:04:46,128 INFO [RS:1;jenkins-hbase20:38887] regionserver.HeapMemoryManager(220): Stopping 2023-10-02 19:04:46,129 INFO [RS:1;jenkins-hbase20:38887] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-02 19:04:46,128 INFO [Listener at jenkins-hbase20.apache.org/42825] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,32897,1696273349258' ***** 2023-10-02 19:04:46,129 INFO [RS:0;jenkins-hbase20:34425] regionserver.HRegionServer(3305): Received CLOSE for 8a36d99e5f9f38c7e20496d80c982ee4 2023-10-02 19:04:46,129 DEBUG [Listener at jenkins-hbase20.apache.org/42825] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 19:04:46,129 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-02 19:04:46,129 INFO [RS:1;jenkins-hbase20:38887] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-02 19:04:46,129 INFO [Listener at jenkins-hbase20.apache.org/42825] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-02 19:04:46,129 INFO [RS:1;jenkins-hbase20:38887] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:46,129 INFO [RS:0;jenkins-hbase20:34425] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:04:46,129 INFO [RS:2;jenkins-hbase20:32897] regionserver.HeapMemoryManager(220): Stopping 2023-10-02 19:04:46,129 DEBUG [RS:1;jenkins-hbase20:38887] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37e735bc to 127.0.0.1:60248 2023-10-02 19:04:46,130 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-02 19:04:46,130 INFO [RS:2;jenkins-hbase20:32897] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-02 19:04:46,130 INFO [RS:2;jenkins-hbase20:32897] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-02 19:04:46,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 8a36d99e5f9f38c7e20496d80c982ee4, disabling compactions & flushes 2023-10-02 19:04:46,130 INFO [RS:2;jenkins-hbase20:32897] regionserver.HRegionServer(3305): Received CLOSE for b7cffa73bdab6c5883d5137f4c4dc219 2023-10-02 19:04:46,129 DEBUG [RS:0;jenkins-hbase20:34425] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41bdb7b3 to 127.0.0.1:60248 2023-10-02 19:04:46,130 INFO [RS:2;jenkins-hbase20:32897] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:46,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing b7cffa73bdab6c5883d5137f4c4dc219, disabling compactions & flushes 2023-10-02 19:04:46,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696273351202.b7cffa73bdab6c5883d5137f4c4dc219. 2023-10-02 19:04:46,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696273351202.b7cffa73bdab6c5883d5137f4c4dc219. 2023-10-02 19:04:46,130 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696273351933.8a36d99e5f9f38c7e20496d80c982ee4. 2023-10-02 19:04:46,130 DEBUG [RS:1;jenkins-hbase20:38887] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:04:46,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696273351933.8a36d99e5f9f38c7e20496d80c982ee4. 2023-10-02 19:04:46,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696273351933.8a36d99e5f9f38c7e20496d80c982ee4. after waiting 0 ms 2023-10-02 19:04:46,133 INFO [RS:1;jenkins-hbase20:38887] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-02 19:04:46,133 INFO [RS:1;jenkins-hbase20:38887] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-02 19:04:46,133 INFO [RS:1;jenkins-hbase20:38887] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-02 19:04:46,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696273351202.b7cffa73bdab6c5883d5137f4c4dc219. after waiting 0 ms 2023-10-02 19:04:46,133 INFO [RS:1;jenkins-hbase20:38887] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-10-02 19:04:46,131 DEBUG [RS:2;jenkins-hbase20:32897] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b91b45b to 127.0.0.1:60248 2023-10-02 19:04:46,131 DEBUG [RS:0;jenkins-hbase20:34425] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:04:46,133 DEBUG [RS:2;jenkins-hbase20:32897] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:04:46,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696273351202.b7cffa73bdab6c5883d5137f4c4dc219. 2023-10-02 19:04:46,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696273351933.8a36d99e5f9f38c7e20496d80c982ee4. 2023-10-02 19:04:46,134 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing b7cffa73bdab6c5883d5137f4c4dc219 1/1 column families, dataSize=78 B heapSize=488 B 2023-10-02 19:04:46,134 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 8a36d99e5f9f38c7e20496d80c982ee4 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-10-02 19:04:46,134 INFO [RS:2;jenkins-hbase20:32897] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-10-02 19:04:46,134 INFO [RS:1;jenkins-hbase20:38887] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-10-02 19:04:46,134 INFO [RS:0;jenkins-hbase20:34425] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-10-02 19:04:46,134 DEBUG [RS:1;jenkins-hbase20:38887] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-10-02 19:04:46,134 DEBUG [RS:0;jenkins-hbase20:34425] regionserver.HRegionServer(1478): Online Regions={8a36d99e5f9f38c7e20496d80c982ee4=hbase:acl,,1696273351933.8a36d99e5f9f38c7e20496d80c982ee4.} 2023-10-02 19:04:46,134 DEBUG [RS:2;jenkins-hbase20:32897] regionserver.HRegionServer(1478): Online Regions={b7cffa73bdab6c5883d5137f4c4dc219=hbase:namespace,,1696273351202.b7cffa73bdab6c5883d5137f4c4dc219.} 2023-10-02 19:04:46,134 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-02 19:04:46,134 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-02 19:04:46,134 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-02 19:04:46,134 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-02 19:04:46,135 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-02 19:04:46,135 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.97 KB heapSize=71.98 KB 2023-10-02 19:04:46,135 DEBUG [RS:1;jenkins-hbase20:38887] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-10-02 19:04:46,135 DEBUG [RS:0;jenkins-hbase20:34425] regionserver.HRegionServer(1504): Waiting on 8a36d99e5f9f38c7e20496d80c982ee4 2023-10-02 19:04:46,135 DEBUG [RS:2;jenkins-hbase20:32897] regionserver.HRegionServer(1504): Waiting on b7cffa73bdab6c5883d5137f4c4dc219 2023-10-02 19:04:46,153 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/acl/8a36d99e5f9f38c7e20496d80c982ee4/.tmp/l/42f71405875c4d53916c30e9348264a6 2023-10-02 19:04:46,153 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/namespace/b7cffa73bdab6c5883d5137f4c4dc219/.tmp/info/6d52cb95b54d4b06a4bab01ccf29f795 2023-10-02 19:04:46,153 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/meta/1588230740/.tmp/info/6a6d9137680d40a3ab642f9fed3613bb 2023-10-02 19:04:46,158 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 42f71405875c4d53916c30e9348264a6 2023-10-02 19:04:46,158 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6a6d9137680d40a3ab642f9fed3613bb 2023-10-02 19:04:46,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/namespace/b7cffa73bdab6c5883d5137f4c4dc219/.tmp/info/6d52cb95b54d4b06a4bab01ccf29f795 as hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/namespace/b7cffa73bdab6c5883d5137f4c4dc219/info/6d52cb95b54d4b06a4bab01ccf29f795 2023-10-02 19:04:46,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/acl/8a36d99e5f9f38c7e20496d80c982ee4/.tmp/l/42f71405875c4d53916c30e9348264a6 as hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/acl/8a36d99e5f9f38c7e20496d80c982ee4/l/42f71405875c4d53916c30e9348264a6 2023-10-02 19:04:46,162 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 42f71405875c4d53916c30e9348264a6 2023-10-02 19:04:46,162 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/namespace/b7cffa73bdab6c5883d5137f4c4dc219/info/6d52cb95b54d4b06a4bab01ccf29f795, entries=2, sequenceid=6, filesize=4.8 K 2023-10-02 19:04:46,163 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/acl/8a36d99e5f9f38c7e20496d80c982ee4/l/42f71405875c4d53916c30e9348264a6, entries=7, sequenceid=18, filesize=5.2 K 2023-10-02 19:04:46,163 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for b7cffa73bdab6c5883d5137f4c4dc219 in 29ms, sequenceid=6, compaction requested=false 2023-10-02 19:04:46,167 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 8a36d99e5f9f38c7e20496d80c982ee4 in 32ms, sequenceid=18, compaction requested=false 2023-10-02 19:04:46,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/namespace/b7cffa73bdab6c5883d5137f4c4dc219/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 19:04:46,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 19:04:46,178 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696273351202.b7cffa73bdab6c5883d5137f4c4dc219. 2023-10-02 19:04:46,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for b7cffa73bdab6c5883d5137f4c4dc219: 2023-10-02 19:04:46,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1696273351202.b7cffa73bdab6c5883d5137f4c4dc219. 2023-10-02 19:04:46,180 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/meta/1588230740/.tmp/rep_barrier/6cce2a3604e34861a2d9de49983f9fa4 2023-10-02 19:04:46,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/acl/8a36d99e5f9f38c7e20496d80c982ee4/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-10-02 19:04:46,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 19:04:46,182 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1696273351933.8a36d99e5f9f38c7e20496d80c982ee4. 2023-10-02 19:04:46,182 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 8a36d99e5f9f38c7e20496d80c982ee4: 2023-10-02 19:04:46,182 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1696273351933.8a36d99e5f9f38c7e20496d80c982ee4. 2023-10-02 19:04:46,184 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-02 19:04:46,184 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-02 19:04:46,190 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-02 19:04:46,191 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6cce2a3604e34861a2d9de49983f9fa4 2023-10-02 19:04:46,205 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/meta/1588230740/.tmp/table/f1c4e70172654d43a33de6a029086496 2023-10-02 19:04:46,209 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f1c4e70172654d43a33de6a029086496 2023-10-02 19:04:46,209 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/meta/1588230740/.tmp/info/6a6d9137680d40a3ab642f9fed3613bb as hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/meta/1588230740/info/6a6d9137680d40a3ab642f9fed3613bb 2023-10-02 19:04:46,213 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6a6d9137680d40a3ab642f9fed3613bb 2023-10-02 19:04:46,213 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/meta/1588230740/info/6a6d9137680d40a3ab642f9fed3613bb, entries=48, sequenceid=131, filesize=10.3 K 2023-10-02 19:04:46,214 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/meta/1588230740/.tmp/rep_barrier/6cce2a3604e34861a2d9de49983f9fa4 as hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/meta/1588230740/rep_barrier/6cce2a3604e34861a2d9de49983f9fa4 2023-10-02 19:04:46,218 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6cce2a3604e34861a2d9de49983f9fa4 2023-10-02 19:04:46,218 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/meta/1588230740/rep_barrier/6cce2a3604e34861a2d9de49983f9fa4, entries=13, sequenceid=131, filesize=6.4 K 2023-10-02 19:04:46,219 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/meta/1588230740/.tmp/table/f1c4e70172654d43a33de6a029086496 as hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/meta/1588230740/table/f1c4e70172654d43a33de6a029086496 2023-10-02 19:04:46,222 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f1c4e70172654d43a33de6a029086496 2023-10-02 19:04:46,222 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/meta/1588230740/table/f1c4e70172654d43a33de6a029086496, entries=24, sequenceid=131, filesize=6.9 K 2023-10-02 19:04:46,223 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.97 KB/47078, heapSize ~71.93 KB/73656, currentSize=0 B/0 for 1588230740 in 88ms, sequenceid=131, compaction requested=false 2023-10-02 19:04:46,233 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-10-02 19:04:46,234 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 19:04:46,234 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-02 19:04:46,234 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-02 19:04:46,234 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-02 19:04:46,235 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-10-02 19:04:46,335 INFO [RS:1;jenkins-hbase20:38887] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,38887,1696273349229; all regions closed. 2023-10-02 19:04:46,335 INFO [RS:0;jenkins-hbase20:34425] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,34425,1696273349187; all regions closed. 2023-10-02 19:04:46,335 INFO [RS:2;jenkins-hbase20:32897] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,32897,1696273349258; all regions closed. 2023-10-02 19:04:46,347 DEBUG [RS:0;jenkins-hbase20:34425] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/oldWALs 2023-10-02 19:04:46,347 DEBUG [RS:2;jenkins-hbase20:32897] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/oldWALs 2023-10-02 19:04:46,348 INFO [RS:2;jenkins-hbase20:32897] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C32897%2C1696273349258:(num 1696273350750) 2023-10-02 19:04:46,348 INFO [RS:0;jenkins-hbase20:34425] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C34425%2C1696273349187:(num 1696273350750) 2023-10-02 19:04:46,348 DEBUG [RS:1;jenkins-hbase20:38887] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/oldWALs 2023-10-02 19:04:46,348 DEBUG [RS:0;jenkins-hbase20:34425] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:04:46,348 DEBUG [RS:2;jenkins-hbase20:32897] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:04:46,348 INFO [RS:0;jenkins-hbase20:34425] regionserver.LeaseManager(133): Closed leases 2023-10-02 19:04:46,348 INFO [RS:2;jenkins-hbase20:32897] regionserver.LeaseManager(133): Closed leases 2023-10-02 19:04:46,348 INFO [RS:1;jenkins-hbase20:38887] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C38887%2C1696273349229.meta:.meta(num 1696273350913) 2023-10-02 19:04:46,349 INFO [RS:2;jenkins-hbase20:32897] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-02 19:04:46,349 INFO [RS:0;jenkins-hbase20:34425] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-02 19:04:46,349 INFO [RS:0;jenkins-hbase20:34425] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-02 19:04:46,349 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-02 19:04:46,350 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-02 19:04:46,350 INFO [RS:2;jenkins-hbase20:32897] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-02 19:04:46,349 INFO [RS:0;jenkins-hbase20:34425] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-02 19:04:46,350 INFO [RS:0;jenkins-hbase20:34425] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-02 19:04:46,350 INFO [RS:2;jenkins-hbase20:32897] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-02 19:04:46,350 INFO [RS:2;jenkins-hbase20:32897] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-02 19:04:46,352 INFO [RS:2;jenkins-hbase20:32897] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:32897 2023-10-02 19:04:46,352 INFO [RS:0;jenkins-hbase20:34425] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:34425 2023-10-02 19:04:46,354 DEBUG [RS:1;jenkins-hbase20:38887] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/oldWALs 2023-10-02 19:04:46,355 INFO [RS:1;jenkins-hbase20:38887] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C38887%2C1696273349229:(num 1696273350750) 2023-10-02 19:04:46,355 DEBUG [RS:1;jenkins-hbase20:38887] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:04:46,355 INFO [RS:1;jenkins-hbase20:38887] regionserver.LeaseManager(133): Closed leases 2023-10-02 19:04:46,355 INFO [RS:1;jenkins-hbase20:38887] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-02 19:04:46,355 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-02 19:04:46,356 INFO [RS:1;jenkins-hbase20:38887] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:38887 2023-10-02 19:04:46,358 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:04:46,358 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:04:46,358 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-02 19:04:46,359 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:46,358 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-02 19:04:46,359 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:46,358 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-02 19:04:46,358 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,34425,1696273349187 2023-10-02 19:04:46,359 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-02 19:04:46,359 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,38887,1696273349229 2023-10-02 19:04:46,359 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:46,359 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:46,359 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,32897,1696273349258] 2023-10-02 19:04:46,359 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,32897,1696273349258 2023-10-02 19:04:46,360 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,32897,1696273349258; numProcessing=1 2023-10-02 19:04:46,361 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,32897,1696273349258 already deleted, retry=false 2023-10-02 19:04:46,361 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,32897,1696273349258 expired; onlineServers=2 2023-10-02 19:04:46,361 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,34425,1696273349187] 2023-10-02 19:04:46,361 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,34425,1696273349187; numProcessing=2 2023-10-02 19:04:46,361 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,34425,1696273349187 already deleted, retry=false 2023-10-02 19:04:46,361 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,34425,1696273349187 expired; onlineServers=1 2023-10-02 19:04:46,361 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,38887,1696273349229] 2023-10-02 19:04:46,361 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,38887,1696273349229; numProcessing=3 2023-10-02 19:04:46,362 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,38887,1696273349229 already deleted, retry=false 2023-10-02 19:04:46,362 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,38887,1696273349229 expired; onlineServers=0 2023-10-02 19:04:46,362 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,32777,1696273348175' ***** 2023-10-02 19:04:46,362 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-10-02 19:04:46,362 DEBUG [M:0;jenkins-hbase20:32777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23b7b452, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-10-02 19:04:46,362 INFO [M:0;jenkins-hbase20:32777] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,32777,1696273348175 2023-10-02 19:04:46,362 INFO [M:0;jenkins-hbase20:32777] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,32777,1696273348175; all regions closed. 2023-10-02 19:04:46,362 DEBUG [M:0;jenkins-hbase20:32777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 19:04:46,362 DEBUG [M:0;jenkins-hbase20:32777] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-10-02 19:04:46,362 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-10-02 19:04:46,362 DEBUG [M:0;jenkins-hbase20:32777] cleaner.HFileCleaner(317): Stopping file delete threads 2023-10-02 19:04:46,362 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1696273350415] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1696273350415,5,FailOnTimeoutGroup] 2023-10-02 19:04:46,362 INFO [M:0;jenkins-hbase20:32777] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-10-02 19:04:46,362 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1696273350417] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1696273350417,5,FailOnTimeoutGroup] 2023-10-02 19:04:46,362 INFO [M:0;jenkins-hbase20:32777] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-10-02 19:04:46,362 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-10-02 19:04:46,362 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 19:04:46,362 INFO [M:0;jenkins-hbase20:32777] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-10-02 19:04:46,363 DEBUG [M:0;jenkins-hbase20:32777] master.HMaster(1512): Stopping service threads 2023-10-02 19:04:46,363 INFO [M:0;jenkins-hbase20:32777] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-10-02 19:04:46,363 ERROR [M:0;jenkins-hbase20:32777] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-13,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-10-02 19:04:46,363 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-02 19:04:46,363 INFO [M:0;jenkins-hbase20:32777] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-10-02 19:04:46,363 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-10-02 19:04:46,364 DEBUG [M:0;jenkins-hbase20:32777] zookeeper.ZKUtil(398): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-10-02 19:04:46,364 WARN [M:0;jenkins-hbase20:32777] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-10-02 19:04:46,364 INFO [M:0;jenkins-hbase20:32777] assignment.AssignmentManager(315): Stopping assignment manager 2023-10-02 19:04:46,364 INFO [M:0;jenkins-hbase20:32777] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-10-02 19:04:46,364 DEBUG [M:0;jenkins-hbase20:32777] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-02 19:04:46,364 INFO [M:0;jenkins-hbase20:32777] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-02 19:04:46,364 DEBUG [M:0;jenkins-hbase20:32777] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-02 19:04:46,365 DEBUG [M:0;jenkins-hbase20:32777] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-02 19:04:46,365 DEBUG [M:0;jenkins-hbase20:32777] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-02 19:04:46,365 INFO [M:0;jenkins-hbase20:32777] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=376.02 KB heapSize=452.25 KB 2023-10-02 19:04:46,376 INFO [M:0;jenkins-hbase20:32777] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=376.02 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a298393407ed4eca8c4543e623e7944f 2023-10-02 19:04:46,380 INFO [M:0;jenkins-hbase20:32777] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a298393407ed4eca8c4543e623e7944f 2023-10-02 19:04:46,381 DEBUG [M:0;jenkins-hbase20:32777] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a298393407ed4eca8c4543e623e7944f as hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a298393407ed4eca8c4543e623e7944f 2023-10-02 19:04:46,385 INFO [M:0;jenkins-hbase20:32777] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a298393407ed4eca8c4543e623e7944f 2023-10-02 19:04:46,385 INFO [M:0;jenkins-hbase20:32777] regionserver.HStore(1080): Added hdfs://localhost:46307/user/jenkins/test-data/40dfee62-b723-30e9-7ce3-de2c1dea23c6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a298393407ed4eca8c4543e623e7944f, entries=119, sequenceid=899, filesize=28.6 K 2023-10-02 19:04:46,386 INFO [M:0;jenkins-hbase20:32777] regionserver.HRegion(2948): Finished flush of dataSize ~376.02 KB/385041, heapSize ~452.23 KB/463088, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=899, compaction requested=false 2023-10-02 19:04:46,387 INFO [M:0;jenkins-hbase20:32777] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-02 19:04:46,387 DEBUG [M:0;jenkins-hbase20:32777] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-02 19:04:46,390 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-02 19:04:46,391 INFO [M:0;jenkins-hbase20:32777] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-10-02 19:04:46,391 INFO [M:0;jenkins-hbase20:32777] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:32777 2023-10-02 19:04:46,392 DEBUG [M:0;jenkins-hbase20:32777] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,32777,1696273348175 already deleted, retry=false 2023-10-02 19:04:46,460 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-02 19:04:46,460 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:38887-0x100f40803d80002, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-02 19:04:46,460 INFO [RS:1;jenkins-hbase20:38887] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,38887,1696273349229; zookeeper connection closed. 2023-10-02 19:04:46,460 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7ed67d86] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7ed67d86 2023-10-02 19:04:46,560 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-02 19:04:46,560 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): master:32777-0x100f40803d80000, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-02 19:04:46,560 INFO [M:0;jenkins-hbase20:32777] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,32777,1696273348175; zookeeper connection closed. 2023-10-02 19:04:46,660 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-02 19:04:46,661 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:32897-0x100f40803d80003, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-02 19:04:46,660 INFO [RS:2;jenkins-hbase20:32897] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,32897,1696273349258; zookeeper connection closed. 2023-10-02 19:04:46,661 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@67f1d906] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@67f1d906 2023-10-02 19:04:46,761 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-02 19:04:46,761 DEBUG [Listener at localhost/36391-EventThread] zookeeper.ZKWatcher(600): regionserver:34425-0x100f40803d80001, quorum=127.0.0.1:60248, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-02 19:04:46,761 INFO [RS:0;jenkins-hbase20:34425] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,34425,1696273349187; zookeeper connection closed. 2023-10-02 19:04:46,762 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4ff6486d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4ff6486d 2023-10-02 19:04:46,762 INFO [Listener at jenkins-hbase20.apache.org/42825] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-10-02 19:04:46,763 WARN [Listener at jenkins-hbase20.apache.org/42825] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-02 19:04:46,771 INFO [Listener at jenkins-hbase20.apache.org/42825] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-02 19:04:46,877 WARN [BP-2016380532-148.251.75.209-1696273344900 heartbeating to localhost/127.0.0.1:46307] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-02 19:04:46,877 WARN [BP-2016380532-148.251.75.209-1696273344900 heartbeating to localhost/127.0.0.1:46307] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2016380532-148.251.75.209-1696273344900 (Datanode Uuid e311bd43-0362-4f03-81e6-0ee20bc00c02) service to localhost/127.0.0.1:46307 2023-10-02 19:04:46,881 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/cluster_34384d40-947b-ffab-8334-c2f5aa364294/dfs/data/data5/current/BP-2016380532-148.251.75.209-1696273344900] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-02 19:04:46,882 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/cluster_34384d40-947b-ffab-8334-c2f5aa364294/dfs/data/data6/current/BP-2016380532-148.251.75.209-1696273344900] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-02 19:04:46,883 WARN [Listener at jenkins-hbase20.apache.org/42825] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-02 19:04:46,885 INFO [Listener at jenkins-hbase20.apache.org/42825] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-02 19:04:46,990 WARN [BP-2016380532-148.251.75.209-1696273344900 heartbeating to localhost/127.0.0.1:46307] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-02 19:04:46,990 WARN [BP-2016380532-148.251.75.209-1696273344900 heartbeating to localhost/127.0.0.1:46307] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2016380532-148.251.75.209-1696273344900 (Datanode Uuid bf3b19c6-9e85-4fec-a2d4-bb513bc39b80) service to localhost/127.0.0.1:46307 2023-10-02 19:04:46,991 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/cluster_34384d40-947b-ffab-8334-c2f5aa364294/dfs/data/data3/current/BP-2016380532-148.251.75.209-1696273344900] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-02 19:04:46,992 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/cluster_34384d40-947b-ffab-8334-c2f5aa364294/dfs/data/data4/current/BP-2016380532-148.251.75.209-1696273344900] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-02 19:04:46,993 WARN [Listener at jenkins-hbase20.apache.org/42825] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-02 19:04:46,997 INFO [Listener at jenkins-hbase20.apache.org/42825] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-02 19:04:47,101 WARN [BP-2016380532-148.251.75.209-1696273344900 heartbeating to localhost/127.0.0.1:46307] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-02 19:04:47,101 WARN [BP-2016380532-148.251.75.209-1696273344900 heartbeating to localhost/127.0.0.1:46307] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2016380532-148.251.75.209-1696273344900 (Datanode Uuid fd21ef95-07f0-48ed-a0b8-dd029034c0b1) service to localhost/127.0.0.1:46307 2023-10-02 19:04:47,102 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/cluster_34384d40-947b-ffab-8334-c2f5aa364294/dfs/data/data1/current/BP-2016380532-148.251.75.209-1696273344900] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-02 19:04:47,102 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/75cd15e3-9822-1a60-76d3-dbad5ad2d0f0/cluster_34384d40-947b-ffab-8334-c2f5aa364294/dfs/data/data2/current/BP-2016380532-148.251.75.209-1696273344900] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-02 19:04:47,123 INFO [Listener at jenkins-hbase20.apache.org/42825] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-02 19:04:47,250 INFO [Listener at jenkins-hbase20.apache.org/42825] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-10-02 19:04:47,328 INFO [Listener at jenkins-hbase20.apache.org/42825] hbase.HBaseTestingUtility(1293): Minicluster is down