2023-10-06 04:00:18,239 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-10-06 04:00:18,454 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75 2023-10-06 04:00:18,455 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-10-06 04:00:18,455 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-10-06 04:00:18,490 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-10-06 04:00:18,693 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-10-06 04:00:18,694 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/cluster_452f40ba-4ad6-c109-846f-078298d21c32, deleteOnExit=true 2023-10-06 04:00:18,694 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-10-06 04:00:18,694 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/test.cache.data in system properties and HBase conf 2023-10-06 04:00:18,695 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/hadoop.tmp.dir in system properties and HBase conf 2023-10-06 04:00:18,695 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/hadoop.log.dir in system properties and HBase conf 2023-10-06 04:00:18,695 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-06 04:00:18,696 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-06 04:00:18,696 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-06 04:00:18,959 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-10-06 04:00:18,963 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-06 04:00:18,964 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-06 04:00:18,964 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-06 04:00:18,964 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-06 04:00:18,964 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-06 04:00:18,965 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-06 04:00:18,965 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-06 04:00:18,965 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-06 04:00:18,966 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-06 04:00:18,966 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/nfs.dump.dir in system properties and HBase conf 2023-10-06 04:00:18,966 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/java.io.tmpdir in system properties and HBase conf 2023-10-06 04:00:18,966 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-06 04:00:18,966 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-06 04:00:18,967 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-10-06 04:00:19,421 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-06 04:00:19,425 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-06 04:00:19,680 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-10-06 04:00:19,822 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-10-06 04:00:19,834 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-06 04:00:19,865 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-10-06 04:00:19,895 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/java.io.tmpdir/Jetty_localhost_39637_hdfs____qgy3ku/webapp 2023-10-06 04:00:20,037 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39637 2023-10-06 04:00:20,086 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-06 04:00:20,086 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-06 04:00:20,491 WARN [Listener at localhost/42421] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-06 04:00:20,570 WARN [Listener at localhost/42421] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-06 04:00:20,592 WARN [Listener at localhost/42421] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-06 04:00:20,600 INFO [Listener at localhost/42421] log.Slf4jLog(67): jetty-6.1.26 2023-10-06 04:00:20,607 INFO [Listener at localhost/42421] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/java.io.tmpdir/Jetty_localhost_44423_datanode____.n7qld0/webapp 2023-10-06 04:00:20,751 INFO [Listener at localhost/42421] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44423 2023-10-06 04:00:21,153 WARN [Listener at localhost/35055] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-06 04:00:21,170 WARN [Listener at localhost/35055] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-06 04:00:21,173 WARN [Listener at localhost/35055] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-06 04:00:21,175 INFO [Listener at localhost/35055] log.Slf4jLog(67): jetty-6.1.26 2023-10-06 04:00:21,187 INFO [Listener at localhost/35055] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/java.io.tmpdir/Jetty_localhost_34689_datanode____.3zbnfn/webapp 2023-10-06 04:00:21,285 INFO [Listener at localhost/35055] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34689 2023-10-06 04:00:21,297 WARN [Listener at localhost/45189] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-06 04:00:21,312 WARN [Listener at localhost/45189] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-06 04:00:21,316 WARN [Listener at localhost/45189] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-06 04:00:21,318 INFO [Listener at localhost/45189] log.Slf4jLog(67): jetty-6.1.26 2023-10-06 04:00:21,323 INFO [Listener at localhost/45189] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/java.io.tmpdir/Jetty_localhost_41931_datanode____.dxxe8v/webapp 2023-10-06 04:00:21,440 INFO [Listener at localhost/45189] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41931 2023-10-06 04:00:21,452 WARN [Listener at localhost/37595] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-06 04:00:21,623 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4fc2724a31bc2a8a: Processing first storage report for DS-2f85b671-af49-4ca1-88f6-59570244b916 from datanode aa1714cb-842d-4067-b1b0-9cb6e05681f8 2023-10-06 04:00:21,625 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4fc2724a31bc2a8a: from storage DS-2f85b671-af49-4ca1-88f6-59570244b916 node DatanodeRegistration(127.0.0.1:38183, datanodeUuid=aa1714cb-842d-4067-b1b0-9cb6e05681f8, infoPort=35541, infoSecurePort=0, ipcPort=37595, storageInfo=lv=-57;cid=testClusterID;nsid=1578803534;c=1696564819492), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-10-06 04:00:21,625 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4495e60ed9615e43: Processing first storage report for DS-97309f9d-4219-4545-b1f2-33871c6e884f from datanode 3359534a-726f-4e44-a325-db30a916325c 2023-10-06 04:00:21,625 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4495e60ed9615e43: from storage DS-97309f9d-4219-4545-b1f2-33871c6e884f node DatanodeRegistration(127.0.0.1:34459, datanodeUuid=3359534a-726f-4e44-a325-db30a916325c, infoPort=38869, infoSecurePort=0, ipcPort=45189, storageInfo=lv=-57;cid=testClusterID;nsid=1578803534;c=1696564819492), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-06 04:00:21,625 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3f52357e3ff903ec: Processing first storage report for DS-198766ca-f627-48f0-9f63-5926e2726f36 from datanode 945ea537-ad1e-44be-b06f-b09fce1700fd 2023-10-06 04:00:21,626 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3f52357e3ff903ec: from storage DS-198766ca-f627-48f0-9f63-5926e2726f36 node DatanodeRegistration(127.0.0.1:45593, datanodeUuid=945ea537-ad1e-44be-b06f-b09fce1700fd, infoPort=41389, infoSecurePort=0, ipcPort=35055, storageInfo=lv=-57;cid=testClusterID;nsid=1578803534;c=1696564819492), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-06 04:00:21,626 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4fc2724a31bc2a8a: Processing first storage report for DS-315d5c03-f7f9-409d-af77-b63016f95b88 from datanode aa1714cb-842d-4067-b1b0-9cb6e05681f8 2023-10-06 04:00:21,626 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4fc2724a31bc2a8a: from storage DS-315d5c03-f7f9-409d-af77-b63016f95b88 node DatanodeRegistration(127.0.0.1:38183, datanodeUuid=aa1714cb-842d-4067-b1b0-9cb6e05681f8, infoPort=35541, infoSecurePort=0, ipcPort=37595, storageInfo=lv=-57;cid=testClusterID;nsid=1578803534;c=1696564819492), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-06 04:00:21,626 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4495e60ed9615e43: Processing first storage report for DS-85a3425d-4d26-4365-9599-061592b058df from datanode 3359534a-726f-4e44-a325-db30a916325c 2023-10-06 04:00:21,626 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4495e60ed9615e43: from storage DS-85a3425d-4d26-4365-9599-061592b058df node DatanodeRegistration(127.0.0.1:34459, datanodeUuid=3359534a-726f-4e44-a325-db30a916325c, infoPort=38869, infoSecurePort=0, ipcPort=45189, storageInfo=lv=-57;cid=testClusterID;nsid=1578803534;c=1696564819492), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-10-06 04:00:21,626 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3f52357e3ff903ec: Processing first storage report for DS-4e76b325-02ba-4ca6-b5f1-5988f600d791 from datanode 945ea537-ad1e-44be-b06f-b09fce1700fd 2023-10-06 04:00:21,627 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3f52357e3ff903ec: from storage DS-4e76b325-02ba-4ca6-b5f1-5988f600d791 node DatanodeRegistration(127.0.0.1:45593, datanodeUuid=945ea537-ad1e-44be-b06f-b09fce1700fd, infoPort=41389, infoSecurePort=0, ipcPort=35055, storageInfo=lv=-57;cid=testClusterID;nsid=1578803534;c=1696564819492), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-06 04:00:21,816 DEBUG [Listener at localhost/37595] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75 2023-10-06 04:00:21,914 INFO [Listener at localhost/37595] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/cluster_452f40ba-4ad6-c109-846f-078298d21c32/zookeeper_0, clientPort=57105, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/cluster_452f40ba-4ad6-c109-846f-078298d21c32/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/cluster_452f40ba-4ad6-c109-846f-078298d21c32/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-10-06 04:00:21,931 INFO [Listener at localhost/37595] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57105 2023-10-06 04:00:21,939 INFO [Listener at localhost/37595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-06 04:00:21,941 INFO [Listener at localhost/37595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-06 04:00:22,627 INFO [Listener at localhost/37595] util.FSUtils(471): Created version file at hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91 with version=8 2023-10-06 04:00:22,627 INFO [Listener at localhost/37595] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/hbase-staging 2023-10-06 04:00:22,972 INFO [Listener at localhost/37595] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-10-06 04:00:23,526 INFO [Listener at localhost/37595] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-10-06 04:00:23,559 INFO [Listener at localhost/37595] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-06 04:00:23,559 INFO [Listener at localhost/37595] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-06 04:00:23,559 INFO [Listener at localhost/37595] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-06 04:00:23,560 INFO [Listener at localhost/37595] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-06 04:00:23,560 INFO [Listener at localhost/37595] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-06 04:00:23,714 INFO [Listener at localhost/37595] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-10-06 04:00:23,787 DEBUG [Listener at localhost/37595] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-10-06 04:00:23,883 INFO [Listener at localhost/37595] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45627 2023-10-06 04:00:23,896 INFO [Listener at localhost/37595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-06 04:00:23,898 INFO [Listener at localhost/37595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-06 04:00:23,920 INFO [Listener at localhost/37595] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45627 connecting to ZooKeeper ensemble=127.0.0.1:57105 2023-10-06 04:00:23,968 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:456270x0, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-06 04:00:23,971 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:45627-0x10119e3f72b0000 connected 2023-10-06 04:00:23,997 DEBUG [Listener at localhost/37595] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-06 04:00:23,997 DEBUG [Listener at localhost/37595] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-06 04:00:24,010 DEBUG [Listener at localhost/37595] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-06 04:00:24,018 DEBUG [Listener at localhost/37595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45627 2023-10-06 04:00:24,018 DEBUG [Listener at localhost/37595] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45627 2023-10-06 04:00:24,018 DEBUG [Listener at localhost/37595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45627 2023-10-06 04:00:24,019 DEBUG [Listener at localhost/37595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45627 2023-10-06 04:00:24,019 DEBUG [Listener at localhost/37595] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45627 2023-10-06 04:00:24,025 INFO [Listener at localhost/37595] master.HMaster(444): hbase.rootdir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91, hbase.cluster.distributed=false 2023-10-06 04:00:24,084 INFO [Listener at localhost/37595] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-06 04:00:24,084 INFO [Listener at localhost/37595] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-06 04:00:24,084 INFO [Listener at localhost/37595] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-06 04:00:24,084 INFO [Listener at localhost/37595] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-06 04:00:24,084 INFO [Listener at localhost/37595] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-06 04:00:24,084 INFO [Listener at localhost/37595] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-06 04:00:24,089 INFO [Listener at localhost/37595] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-06 04:00:24,092 INFO [Listener at localhost/37595] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36351 2023-10-06 04:00:24,095 INFO [Listener at localhost/37595] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-06 04:00:24,101 INFO [Listener at localhost/37595] mob.MobFileCache(125): MobFileCache disabled 2023-10-06 04:00:24,103 INFO [Listener at localhost/37595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-06 04:00:24,104 INFO [Listener at localhost/37595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-06 04:00:24,107 INFO [Listener at localhost/37595] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36351 connecting to ZooKeeper ensemble=127.0.0.1:57105 2023-10-06 04:00:24,115 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:363510x0, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-06 04:00:24,116 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36351-0x10119e3f72b0001 connected 2023-10-06 04:00:24,116 DEBUG [Listener at localhost/37595] zookeeper.ZKUtil(164): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-06 04:00:24,117 DEBUG [Listener at localhost/37595] zookeeper.ZKUtil(164): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-06 04:00:24,118 DEBUG [Listener at localhost/37595] zookeeper.ZKUtil(164): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-06 04:00:24,119 DEBUG [Listener at localhost/37595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36351 2023-10-06 04:00:24,119 DEBUG [Listener at localhost/37595] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36351 2023-10-06 04:00:24,119 DEBUG [Listener at localhost/37595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36351 2023-10-06 04:00:24,120 DEBUG [Listener at localhost/37595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36351 2023-10-06 04:00:24,120 DEBUG [Listener at localhost/37595] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36351 2023-10-06 04:00:24,132 INFO [Listener at localhost/37595] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-06 04:00:24,133 INFO [Listener at localhost/37595] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-06 04:00:24,133 INFO [Listener at localhost/37595] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-06 04:00:24,134 INFO [Listener at localhost/37595] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-06 04:00:24,134 INFO [Listener at localhost/37595] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-06 04:00:24,134 INFO [Listener at localhost/37595] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-06 04:00:24,134 INFO [Listener at localhost/37595] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-06 04:00:24,136 INFO [Listener at localhost/37595] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38169 2023-10-06 04:00:24,136 INFO [Listener at localhost/37595] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-06 04:00:24,138 INFO [Listener at localhost/37595] mob.MobFileCache(125): MobFileCache disabled 2023-10-06 04:00:24,139 INFO [Listener at localhost/37595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-06 04:00:24,141 INFO [Listener at localhost/37595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-06 04:00:24,143 INFO [Listener at localhost/37595] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38169 connecting to ZooKeeper ensemble=127.0.0.1:57105 2023-10-06 04:00:24,147 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:381690x0, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-06 04:00:24,148 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38169-0x10119e3f72b0002 connected 2023-10-06 04:00:24,149 DEBUG [Listener at localhost/37595] zookeeper.ZKUtil(164): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-06 04:00:24,149 DEBUG [Listener at localhost/37595] zookeeper.ZKUtil(164): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-06 04:00:24,150 DEBUG [Listener at localhost/37595] zookeeper.ZKUtil(164): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-06 04:00:24,153 DEBUG [Listener at localhost/37595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38169 2023-10-06 04:00:24,153 DEBUG [Listener at localhost/37595] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38169 2023-10-06 04:00:24,153 DEBUG [Listener at localhost/37595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38169 2023-10-06 04:00:24,154 DEBUG [Listener at localhost/37595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38169 2023-10-06 04:00:24,155 DEBUG [Listener at localhost/37595] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38169 2023-10-06 04:00:24,168 INFO [Listener at localhost/37595] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-06 04:00:24,168 INFO [Listener at localhost/37595] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-06 04:00:24,168 INFO [Listener at localhost/37595] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-06 04:00:24,168 INFO [Listener at localhost/37595] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-06 04:00:24,169 INFO [Listener at localhost/37595] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-06 04:00:24,169 INFO [Listener at localhost/37595] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-06 04:00:24,169 INFO [Listener at localhost/37595] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-06 04:00:24,170 INFO [Listener at localhost/37595] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36359 2023-10-06 04:00:24,171 INFO [Listener at localhost/37595] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-06 04:00:24,171 INFO [Listener at localhost/37595] mob.MobFileCache(125): MobFileCache disabled 2023-10-06 04:00:24,172 INFO [Listener at localhost/37595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-06 04:00:24,174 INFO [Listener at localhost/37595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-06 04:00:24,175 INFO [Listener at localhost/37595] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36359 connecting to ZooKeeper ensemble=127.0.0.1:57105 2023-10-06 04:00:24,178 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:363590x0, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-06 04:00:24,179 DEBUG [Listener at localhost/37595] zookeeper.ZKUtil(164): regionserver:363590x0, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-06 04:00:24,180 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36359-0x10119e3f72b0003 connected 2023-10-06 04:00:24,180 DEBUG [Listener at localhost/37595] zookeeper.ZKUtil(164): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-06 04:00:24,181 DEBUG [Listener at localhost/37595] zookeeper.ZKUtil(164): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-06 04:00:24,185 DEBUG [Listener at localhost/37595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36359 2023-10-06 04:00:24,185 DEBUG [Listener at localhost/37595] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36359 2023-10-06 04:00:24,187 DEBUG [Listener at localhost/37595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36359 2023-10-06 04:00:24,187 DEBUG [Listener at localhost/37595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36359 2023-10-06 04:00:24,188 DEBUG [Listener at localhost/37595] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36359 2023-10-06 04:00:24,190 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,45627,1696564822800 2023-10-06 04:00:24,202 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-06 04:00:24,204 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,45627,1696564822800 2023-10-06 04:00:24,228 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-06 04:00:24,228 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-06 04:00:24,228 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-06 04:00:24,228 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-06 04:00:24,228 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-06 04:00:24,230 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-06 04:00:24,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,45627,1696564822800 from backup master directory 2023-10-06 04:00:24,232 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-06 04:00:24,236 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,45627,1696564822800 2023-10-06 04:00:24,236 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-06 04:00:24,237 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-06 04:00:24,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,45627,1696564822800 2023-10-06 04:00:24,240 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-10-06 04:00:24,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-10-06 04:00:24,333 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/hbase.id with ID: f05e6cfa-bc49-49b0-8804-a669a0eafa79 2023-10-06 04:00:24,374 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-06 04:00:24,389 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-06 04:00:24,440 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3dd4d95a to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 04:00:24,473 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3da1e71f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 04:00:24,499 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-06 04:00:24,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-10-06 04:00:24,528 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-10-06 04:00:24,528 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-10-06 04:00:24,530 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-06 04:00:24,536 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-06 04:00:24,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-06 04:00:24,582 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/MasterData/data/master/store-tmp 2023-10-06 04:00:24,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:00:24,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-06 04:00:24,620 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-06 04:00:24,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-06 04:00:24,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-06 04:00:24,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-06 04:00:24,620 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-06 04:00:24,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-06 04:00:24,622 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/MasterData/WALs/jenkins-hbase4.apache.org,45627,1696564822800 2023-10-06 04:00:24,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45627%2C1696564822800, suffix=, logDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/MasterData/WALs/jenkins-hbase4.apache.org,45627,1696564822800, archiveDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/MasterData/oldWALs, maxLogs=10 2023-10-06 04:00:24,697 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38183,DS-2f85b671-af49-4ca1-88f6-59570244b916,DISK] 2023-10-06 04:00:24,697 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34459,DS-97309f9d-4219-4545-b1f2-33871c6e884f,DISK] 2023-10-06 04:00:24,697 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45593,DS-198766ca-f627-48f0-9f63-5926e2726f36,DISK] 2023-10-06 04:00:24,706 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-10-06 04:00:24,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/MasterData/WALs/jenkins-hbase4.apache.org,45627,1696564822800/jenkins-hbase4.apache.org%2C45627%2C1696564822800.1696564824654 2023-10-06 04:00:24,771 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38183,DS-2f85b671-af49-4ca1-88f6-59570244b916,DISK], DatanodeInfoWithStorage[127.0.0.1:34459,DS-97309f9d-4219-4545-b1f2-33871c6e884f,DISK], DatanodeInfoWithStorage[127.0.0.1:45593,DS-198766ca-f627-48f0-9f63-5926e2726f36,DISK]] 2023-10-06 04:00:24,772 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-10-06 04:00:24,772 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:00:24,776 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-10-06 04:00:24,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-10-06 04:00:24,853 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-10-06 04:00:24,861 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-10-06 04:00:24,898 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-10-06 04:00:24,911 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 04:00:24,917 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-06 04:00:24,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-06 04:00:24,935 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-10-06 04:00:24,941 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 04:00:24,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64289760, jitterRate=-0.0420079231262207}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 04:00:24,942 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-06 04:00:24,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-10-06 04:00:24,970 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-10-06 04:00:24,970 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-10-06 04:00:24,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-10-06 04:00:24,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-10-06 04:00:25,012 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 36 msec 2023-10-06 04:00:25,012 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-10-06 04:00:25,042 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-10-06 04:00:25,048 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-10-06 04:00:25,080 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-10-06 04:00:25,087 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-10-06 04:00:25,089 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-10-06 04:00:25,096 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-10-06 04:00:25,100 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-10-06 04:00:25,110 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-06 04:00:25,112 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-10-06 04:00:25,112 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-10-06 04:00:25,126 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-10-06 04:00:25,130 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-06 04:00:25,130 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-06 04:00:25,130 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-06 04:00:25,130 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-06 04:00:25,130 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-06 04:00:25,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,45627,1696564822800, sessionid=0x10119e3f72b0000, setting cluster-up flag (Was=false) 2023-10-06 04:00:25,154 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-06 04:00:25,161 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-10-06 04:00:25,163 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45627,1696564822800 2023-10-06 04:00:25,169 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-06 04:00:25,175 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-10-06 04:00:25,176 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45627,1696564822800 2023-10-06 04:00:25,179 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp 2023-10-06 04:00:25,192 INFO [RS:1;jenkins-hbase4:38169] regionserver.HRegionServer(951): ClusterId : f05e6cfa-bc49-49b0-8804-a669a0eafa79 2023-10-06 04:00:25,193 INFO [RS:2;jenkins-hbase4:36359] regionserver.HRegionServer(951): ClusterId : f05e6cfa-bc49-49b0-8804-a669a0eafa79 2023-10-06 04:00:25,193 INFO [RS:0;jenkins-hbase4:36351] regionserver.HRegionServer(951): ClusterId : f05e6cfa-bc49-49b0-8804-a669a0eafa79 2023-10-06 04:00:25,201 DEBUG [RS:0;jenkins-hbase4:36351] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-06 04:00:25,201 DEBUG [RS:2;jenkins-hbase4:36359] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-06 04:00:25,201 DEBUG [RS:1;jenkins-hbase4:38169] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-06 04:00:25,214 DEBUG [RS:1;jenkins-hbase4:38169] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-06 04:00:25,214 DEBUG [RS:1;jenkins-hbase4:38169] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-06 04:00:25,214 DEBUG [RS:2;jenkins-hbase4:36359] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-06 04:00:25,214 DEBUG [RS:0;jenkins-hbase4:36351] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-06 04:00:25,214 DEBUG [RS:2;jenkins-hbase4:36359] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-06 04:00:25,215 DEBUG [RS:0;jenkins-hbase4:36351] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-06 04:00:25,219 DEBUG [RS:1;jenkins-hbase4:38169] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-06 04:00:25,219 DEBUG [RS:0;jenkins-hbase4:36351] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-06 04:00:25,220 DEBUG [RS:2;jenkins-hbase4:36359] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-06 04:00:25,228 DEBUG [RS:0;jenkins-hbase4:36351] zookeeper.ReadOnlyZKClient(139): Connect 0x2bef1184 to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 04:00:25,229 DEBUG [RS:1;jenkins-hbase4:38169] zookeeper.ReadOnlyZKClient(139): Connect 0x6eb23143 to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 04:00:25,230 DEBUG [RS:2;jenkins-hbase4:36359] zookeeper.ReadOnlyZKClient(139): Connect 0x44cb4aa9 to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 04:00:25,242 DEBUG [RS:0;jenkins-hbase4:36351] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5be851b2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 04:00:25,243 DEBUG [RS:0;jenkins-hbase4:36351] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f275c05, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-06 04:00:25,273 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-10-06 04:00:25,276 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 04:00:25,277 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-10-06 04:00:25,280 DEBUG [RS:1;jenkins-hbase4:38169] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25b1678a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 04:00:25,280 DEBUG [RS:2;jenkins-hbase4:36359] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a0cac40, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 04:00:25,281 DEBUG [RS:1;jenkins-hbase4:38169] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e869539, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-06 04:00:25,282 DEBUG [RS:2;jenkins-hbase4:36359] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b31a67b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-06 04:00:25,300 DEBUG [RS:2;jenkins-hbase4:36359] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:36359 2023-10-06 04:00:25,300 DEBUG [RS:0;jenkins-hbase4:36351] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:36351 2023-10-06 04:00:25,300 DEBUG [RS:1;jenkins-hbase4:38169] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:38169 2023-10-06 04:00:25,305 INFO [RS:1;jenkins-hbase4:38169] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-06 04:00:25,305 INFO [RS:0;jenkins-hbase4:36351] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-06 04:00:25,305 INFO [RS:2;jenkins-hbase4:36359] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-06 04:00:25,306 INFO [RS:2;jenkins-hbase4:36359] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-06 04:00:25,306 INFO [RS:0;jenkins-hbase4:36351] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-06 04:00:25,305 INFO [RS:1;jenkins-hbase4:38169] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-06 04:00:25,306 DEBUG [RS:2;jenkins-hbase4:36359] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-06 04:00:25,306 DEBUG [RS:0;jenkins-hbase4:36351] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-06 04:00:25,306 DEBUG [RS:1;jenkins-hbase4:38169] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-06 04:00:25,307 INFO [RS:2;jenkins-hbase4:36359] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 04:00:25,308 DEBUG [RS:2;jenkins-hbase4:36359] regionserver.HRegionServer(1022): About to register with Master. 2023-10-06 04:00:25,308 INFO [RS:0;jenkins-hbase4:36351] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 04:00:25,308 DEBUG [RS:0;jenkins-hbase4:36351] regionserver.HRegionServer(1022): About to register with Master. 2023-10-06 04:00:25,308 INFO [RS:1;jenkins-hbase4:38169] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 04:00:25,309 DEBUG [RS:1;jenkins-hbase4:38169] regionserver.HRegionServer(1022): About to register with Master. 2023-10-06 04:00:25,311 INFO [RS:2;jenkins-hbase4:36359] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45627,1696564822800 with isa=jenkins-hbase4.apache.org/172.31.14.131:36359, startcode=1696564824167 2023-10-06 04:00:25,311 INFO [RS:0;jenkins-hbase4:36351] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45627,1696564822800 with isa=jenkins-hbase4.apache.org/172.31.14.131:36351, startcode=1696564824083 2023-10-06 04:00:25,311 INFO [RS:1;jenkins-hbase4:38169] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45627,1696564822800 with isa=jenkins-hbase4.apache.org/172.31.14.131:38169, startcode=1696564824132 2023-10-06 04:00:25,330 DEBUG [RS:0;jenkins-hbase4:36351] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-06 04:00:25,330 DEBUG [RS:2;jenkins-hbase4:36359] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-06 04:00:25,330 DEBUG [RS:1;jenkins-hbase4:38169] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-06 04:00:25,359 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-10-06 04:00:25,371 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-06 04:00:25,372 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-06 04:00:25,372 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-06 04:00:25,372 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-06 04:00:25,372 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-10-06 04:00:25,372 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 04:00:25,372 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-06 04:00:25,372 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 04:00:25,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1696564855378 2023-10-06 04:00:25,381 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-10-06 04:00:25,383 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-10-06 04:00:25,383 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-10-06 04:00:25,390 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-06 04:00:25,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-10-06 04:00:25,395 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47511, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-10-06 04:00:25,395 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50791, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-10-06 04:00:25,395 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41329, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-10-06 04:00:25,403 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-10-06 04:00:25,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-10-06 04:00:25,405 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-10-06 04:00:25,405 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-10-06 04:00:25,406 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-06 04:00:25,407 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45627] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-06 04:00:25,410 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-10-06 04:00:25,412 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-10-06 04:00:25,413 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-10-06 04:00:25,419 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45627] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-06 04:00:25,419 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45627] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-06 04:00:25,421 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-10-06 04:00:25,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-10-06 04:00:25,430 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696564825426,5,FailOnTimeoutGroup] 2023-10-06 04:00:25,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696564825431,5,FailOnTimeoutGroup] 2023-10-06 04:00:25,437 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-06 04:00:25,437 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-10-06 04:00:25,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-10-06 04:00:25,443 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-10-06 04:00:25,453 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-06 04:00:25,454 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-06 04:00:25,455 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91 2023-10-06 04:00:25,460 DEBUG [RS:2;jenkins-hbase4:36359] regionserver.HRegionServer(2830): Master is not running yet 2023-10-06 04:00:25,460 WARN [RS:2;jenkins-hbase4:36359] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-06 04:00:25,460 DEBUG [RS:0;jenkins-hbase4:36351] regionserver.HRegionServer(2830): Master is not running yet 2023-10-06 04:00:25,460 DEBUG [RS:1;jenkins-hbase4:38169] regionserver.HRegionServer(2830): Master is not running yet 2023-10-06 04:00:25,461 WARN [RS:0;jenkins-hbase4:36351] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-06 04:00:25,461 WARN [RS:1;jenkins-hbase4:38169] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-06 04:00:25,487 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:00:25,489 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-06 04:00:25,492 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/meta/1588230740/info 2023-10-06 04:00:25,492 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-06 04:00:25,493 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 04:00:25,493 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-06 04:00:25,496 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/meta/1588230740/rep_barrier 2023-10-06 04:00:25,497 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-06 04:00:25,497 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 04:00:25,498 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-06 04:00:25,500 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/meta/1588230740/table 2023-10-06 04:00:25,500 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-06 04:00:25,501 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 04:00:25,502 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/meta/1588230740 2023-10-06 04:00:25,503 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/meta/1588230740 2023-10-06 04:00:25,507 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-06 04:00:25,509 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-06 04:00:25,513 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 04:00:25,514 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68174512, jitterRate=0.015879392623901367}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-06 04:00:25,514 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-06 04:00:25,514 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-06 04:00:25,514 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-06 04:00:25,514 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-06 04:00:25,514 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-06 04:00:25,514 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-06 04:00:25,516 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-06 04:00:25,516 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-06 04:00:25,522 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-10-06 04:00:25,522 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-10-06 04:00:25,532 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-10-06 04:00:25,544 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-10-06 04:00:25,548 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-10-06 04:00:25,561 INFO [RS:2;jenkins-hbase4:36359] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45627,1696564822800 with isa=jenkins-hbase4.apache.org/172.31.14.131:36359, startcode=1696564824167 2023-10-06 04:00:25,562 INFO [RS:0;jenkins-hbase4:36351] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45627,1696564822800 with isa=jenkins-hbase4.apache.org/172.31.14.131:36351, startcode=1696564824083 2023-10-06 04:00:25,562 INFO [RS:1;jenkins-hbase4:38169] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45627,1696564822800 with isa=jenkins-hbase4.apache.org/172.31.14.131:38169, startcode=1696564824132 2023-10-06 04:00:25,567 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45627] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:25,575 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45627] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:25,575 DEBUG [RS:2;jenkins-hbase4:36359] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91 2023-10-06 04:00:25,575 DEBUG [RS:2;jenkins-hbase4:36359] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42421 2023-10-06 04:00:25,575 DEBUG [RS:2;jenkins-hbase4:36359] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-06 04:00:25,576 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45627] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:25,576 DEBUG [RS:1;jenkins-hbase4:38169] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91 2023-10-06 04:00:25,576 DEBUG [RS:1;jenkins-hbase4:38169] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42421 2023-10-06 04:00:25,577 DEBUG [RS:1;jenkins-hbase4:38169] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-06 04:00:25,577 DEBUG [RS:0;jenkins-hbase4:36351] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91 2023-10-06 04:00:25,577 DEBUG [RS:0;jenkins-hbase4:36351] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42421 2023-10-06 04:00:25,577 DEBUG [RS:0;jenkins-hbase4:36351] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-06 04:00:25,584 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-06 04:00:25,585 DEBUG [RS:0;jenkins-hbase4:36351] zookeeper.ZKUtil(162): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:25,585 DEBUG [RS:2;jenkins-hbase4:36359] zookeeper.ZKUtil(162): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:25,586 WARN [RS:0;jenkins-hbase4:36351] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-06 04:00:25,586 DEBUG [RS:1;jenkins-hbase4:38169] zookeeper.ZKUtil(162): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:25,586 INFO [RS:0;jenkins-hbase4:36351] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-06 04:00:25,586 WARN [RS:2;jenkins-hbase4:36359] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-06 04:00:25,586 WARN [RS:1;jenkins-hbase4:38169] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-06 04:00:25,587 DEBUG [RS:0;jenkins-hbase4:36351] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/WALs/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:25,587 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38169,1696564824132] 2023-10-06 04:00:25,586 INFO [RS:2;jenkins-hbase4:36359] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-06 04:00:25,587 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36351,1696564824083] 2023-10-06 04:00:25,587 INFO [RS:1;jenkins-hbase4:38169] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-06 04:00:25,587 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36359,1696564824167] 2023-10-06 04:00:25,587 DEBUG [RS:1;jenkins-hbase4:38169] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/WALs/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:25,587 DEBUG [RS:2;jenkins-hbase4:36359] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/WALs/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:25,604 DEBUG [RS:1;jenkins-hbase4:38169] zookeeper.ZKUtil(162): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:25,604 DEBUG [RS:0;jenkins-hbase4:36351] zookeeper.ZKUtil(162): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:25,604 DEBUG [RS:2;jenkins-hbase4:36359] zookeeper.ZKUtil(162): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:25,605 DEBUG [RS:1;jenkins-hbase4:38169] zookeeper.ZKUtil(162): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:25,605 DEBUG [RS:0;jenkins-hbase4:36351] zookeeper.ZKUtil(162): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:25,605 DEBUG [RS:2;jenkins-hbase4:36359] zookeeper.ZKUtil(162): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:25,605 DEBUG [RS:1;jenkins-hbase4:38169] zookeeper.ZKUtil(162): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:25,605 DEBUG [RS:0;jenkins-hbase4:36351] zookeeper.ZKUtil(162): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:25,605 DEBUG [RS:2;jenkins-hbase4:36359] zookeeper.ZKUtil(162): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:25,618 DEBUG [RS:0;jenkins-hbase4:36351] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-06 04:00:25,618 DEBUG [RS:2;jenkins-hbase4:36359] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-06 04:00:25,618 DEBUG [RS:1;jenkins-hbase4:38169] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-06 04:00:25,628 INFO [RS:0;jenkins-hbase4:36351] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-06 04:00:25,628 INFO [RS:2;jenkins-hbase4:36359] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-06 04:00:25,628 INFO [RS:1;jenkins-hbase4:38169] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-06 04:00:25,651 INFO [RS:1;jenkins-hbase4:38169] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-06 04:00:25,653 INFO [RS:0;jenkins-hbase4:36351] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-06 04:00:25,654 INFO [RS:2;jenkins-hbase4:36359] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-06 04:00:25,657 INFO [RS:1;jenkins-hbase4:38169] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-06 04:00:25,657 INFO [RS:0;jenkins-hbase4:36351] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-06 04:00:25,657 INFO [RS:2;jenkins-hbase4:36359] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-06 04:00:25,657 INFO [RS:0;jenkins-hbase4:36351] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-06 04:00:25,657 INFO [RS:1;jenkins-hbase4:38169] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-06 04:00:25,657 INFO [RS:2;jenkins-hbase4:36359] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-06 04:00:25,658 INFO [RS:0;jenkins-hbase4:36351] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-06 04:00:25,658 INFO [RS:1;jenkins-hbase4:38169] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-06 04:00:25,658 INFO [RS:2;jenkins-hbase4:36359] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-06 04:00:25,667 INFO [RS:1;jenkins-hbase4:38169] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-06 04:00:25,667 INFO [RS:2;jenkins-hbase4:36359] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-06 04:00:25,667 INFO [RS:0;jenkins-hbase4:36351] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-06 04:00:25,667 DEBUG [RS:1;jenkins-hbase4:38169] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 04:00:25,667 DEBUG [RS:2;jenkins-hbase4:36359] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 04:00:25,668 DEBUG [RS:1;jenkins-hbase4:38169] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 04:00:25,668 DEBUG [RS:0;jenkins-hbase4:36351] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 04:00:25,668 DEBUG [RS:1;jenkins-hbase4:38169] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 04:00:25,668 DEBUG [RS:0;jenkins-hbase4:36351] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 04:00:25,668 DEBUG [RS:1;jenkins-hbase4:38169] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 04:00:25,668 DEBUG [RS:0;jenkins-hbase4:36351] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 04:00:25,668 DEBUG [RS:1;jenkins-hbase4:38169] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 04:00:25,668 DEBUG [RS:0;jenkins-hbase4:36351] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 04:00:25,668 DEBUG [RS:1;jenkins-hbase4:38169] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-06 04:00:25,668 DEBUG [RS:0;jenkins-hbase4:36351] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 04:00:25,668 DEBUG [RS:1;jenkins-hbase4:38169] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 04:00:25,668 DEBUG [RS:0;jenkins-hbase4:36351] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-06 04:00:25,668 DEBUG [RS:1;jenkins-hbase4:38169] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 04:00:25,668 DEBUG [RS:0;jenkins-hbase4:36351] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 04:00:25,668 DEBUG [RS:1;jenkins-hbase4:38169] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 04:00:25,668 DEBUG [RS:0;jenkins-hbase4:36351] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 04:00:25,668 DEBUG [RS:1;jenkins-hbase4:38169] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 04:00:25,668 DEBUG [RS:2;jenkins-hbase4:36359] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 04:00:25,669 DEBUG [RS:0;jenkins-hbase4:36351] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 04:00:25,669 DEBUG [RS:2;jenkins-hbase4:36359] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 04:00:25,669 DEBUG [RS:0;jenkins-hbase4:36351] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 04:00:25,669 DEBUG [RS:2;jenkins-hbase4:36359] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 04:00:25,669 DEBUG [RS:2;jenkins-hbase4:36359] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 04:00:25,670 DEBUG [RS:2;jenkins-hbase4:36359] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-06 04:00:25,670 DEBUG [RS:2;jenkins-hbase4:36359] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 04:00:25,670 DEBUG [RS:2;jenkins-hbase4:36359] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 04:00:25,670 DEBUG [RS:2;jenkins-hbase4:36359] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 04:00:25,671 DEBUG [RS:2;jenkins-hbase4:36359] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 04:00:25,673 INFO [RS:1;jenkins-hbase4:38169] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-06 04:00:25,673 INFO [RS:1;jenkins-hbase4:38169] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-06 04:00:25,673 INFO [RS:1;jenkins-hbase4:38169] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-06 04:00:25,673 INFO [RS:0;jenkins-hbase4:36351] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-06 04:00:25,674 INFO [RS:0;jenkins-hbase4:36351] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-06 04:00:25,674 INFO [RS:0;jenkins-hbase4:36351] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-06 04:00:25,674 INFO [RS:2;jenkins-hbase4:36359] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-06 04:00:25,674 INFO [RS:2;jenkins-hbase4:36359] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-06 04:00:25,674 INFO [RS:2;jenkins-hbase4:36359] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-06 04:00:25,690 INFO [RS:1;jenkins-hbase4:38169] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-06 04:00:25,690 INFO [RS:0;jenkins-hbase4:36351] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-06 04:00:25,692 INFO [RS:2;jenkins-hbase4:36359] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-06 04:00:25,694 INFO [RS:1;jenkins-hbase4:38169] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38169,1696564824132-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-06 04:00:25,694 INFO [RS:2;jenkins-hbase4:36359] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36359,1696564824167-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-06 04:00:25,694 INFO [RS:0;jenkins-hbase4:36351] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36351,1696564824083-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-06 04:00:25,700 DEBUG [jenkins-hbase4:45627] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-10-06 04:00:25,706 DEBUG [jenkins-hbase4:45627] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-06 04:00:25,713 DEBUG [jenkins-hbase4:45627] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-06 04:00:25,713 DEBUG [jenkins-hbase4:45627] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-06 04:00:25,713 DEBUG [jenkins-hbase4:45627] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-06 04:00:25,713 DEBUG [jenkins-hbase4:45627] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-06 04:00:25,717 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36351,1696564824083, state=OPENING 2023-10-06 04:00:25,719 INFO [RS:2;jenkins-hbase4:36359] regionserver.Replication(203): jenkins-hbase4.apache.org,36359,1696564824167 started 2023-10-06 04:00:25,719 INFO [RS:2;jenkins-hbase4:36359] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,36359,1696564824167, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36359, sessionid=0x10119e3f72b0003 2023-10-06 04:00:25,721 INFO [RS:1;jenkins-hbase4:38169] regionserver.Replication(203): jenkins-hbase4.apache.org,38169,1696564824132 started 2023-10-06 04:00:25,721 INFO [RS:1;jenkins-hbase4:38169] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,38169,1696564824132, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38169, sessionid=0x10119e3f72b0002 2023-10-06 04:00:25,723 INFO [RS:0;jenkins-hbase4:36351] regionserver.Replication(203): jenkins-hbase4.apache.org,36351,1696564824083 started 2023-10-06 04:00:25,723 DEBUG [RS:1;jenkins-hbase4:38169] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-06 04:00:25,723 DEBUG [RS:2;jenkins-hbase4:36359] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-06 04:00:25,723 DEBUG [RS:1;jenkins-hbase4:38169] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:25,723 INFO [RS:0;jenkins-hbase4:36351] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,36351,1696564824083, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36351, sessionid=0x10119e3f72b0001 2023-10-06 04:00:25,724 DEBUG [RS:1;jenkins-hbase4:38169] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38169,1696564824132' 2023-10-06 04:00:25,724 DEBUG [RS:0;jenkins-hbase4:36351] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-06 04:00:25,724 DEBUG [RS:0;jenkins-hbase4:36351] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:25,723 DEBUG [RS:2;jenkins-hbase4:36359] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:25,724 DEBUG [RS:0;jenkins-hbase4:36351] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36351,1696564824083' 2023-10-06 04:00:25,724 DEBUG [RS:0;jenkins-hbase4:36351] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-06 04:00:25,724 DEBUG [RS:1;jenkins-hbase4:38169] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-06 04:00:25,724 DEBUG [RS:2;jenkins-hbase4:36359] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36359,1696564824167' 2023-10-06 04:00:25,725 DEBUG [RS:2;jenkins-hbase4:36359] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-06 04:00:25,725 DEBUG [RS:1;jenkins-hbase4:38169] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-06 04:00:25,725 DEBUG [RS:2;jenkins-hbase4:36359] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-06 04:00:25,725 DEBUG [RS:0;jenkins-hbase4:36351] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-06 04:00:25,726 DEBUG [RS:1;jenkins-hbase4:38169] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-06 04:00:25,726 DEBUG [RS:2;jenkins-hbase4:36359] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-06 04:00:25,726 DEBUG [RS:0;jenkins-hbase4:36351] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-06 04:00:25,726 DEBUG [RS:2;jenkins-hbase4:36359] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-06 04:00:25,726 DEBUG [RS:1;jenkins-hbase4:38169] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-06 04:00:25,726 DEBUG [RS:2;jenkins-hbase4:36359] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:25,726 DEBUG [RS:0;jenkins-hbase4:36351] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-06 04:00:25,727 DEBUG [RS:2;jenkins-hbase4:36359] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36359,1696564824167' 2023-10-06 04:00:25,727 DEBUG [RS:2;jenkins-hbase4:36359] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:00:25,726 DEBUG [RS:1;jenkins-hbase4:38169] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:25,727 DEBUG [RS:1;jenkins-hbase4:38169] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38169,1696564824132' 2023-10-06 04:00:25,727 DEBUG [RS:0;jenkins-hbase4:36351] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:25,727 DEBUG [RS:0;jenkins-hbase4:36351] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36351,1696564824083' 2023-10-06 04:00:25,727 DEBUG [RS:0;jenkins-hbase4:36351] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:00:25,727 DEBUG [RS:1;jenkins-hbase4:38169] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:00:25,728 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-10-06 04:00:25,728 DEBUG [RS:0;jenkins-hbase4:36351] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:00:25,728 DEBUG [RS:2;jenkins-hbase4:36359] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:00:25,729 DEBUG [RS:1;jenkins-hbase4:38169] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:00:25,731 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-06 04:00:25,731 DEBUG [RS:1;jenkins-hbase4:38169] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-06 04:00:25,731 DEBUG [RS:2;jenkins-hbase4:36359] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-06 04:00:25,731 DEBUG [RS:0;jenkins-hbase4:36351] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-06 04:00:25,731 INFO [RS:1;jenkins-hbase4:38169] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-06 04:00:25,731 INFO [RS:0;jenkins-hbase4:36351] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-06 04:00:25,731 INFO [RS:2;jenkins-hbase4:36359] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-06 04:00:25,732 INFO [RS:0;jenkins-hbase4:36351] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-06 04:00:25,732 INFO [RS:1;jenkins-hbase4:38169] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-06 04:00:25,733 INFO [RS:2;jenkins-hbase4:36359] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-06 04:00:25,733 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-06 04:00:25,737 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36351,1696564824083}] 2023-10-06 04:00:25,845 INFO [RS:0;jenkins-hbase4:36351] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36351%2C1696564824083, suffix=, logDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/WALs/jenkins-hbase4.apache.org,36351,1696564824083, archiveDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/oldWALs, maxLogs=32 2023-10-06 04:00:25,845 INFO [RS:2;jenkins-hbase4:36359] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36359%2C1696564824167, suffix=, logDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/WALs/jenkins-hbase4.apache.org,36359,1696564824167, archiveDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/oldWALs, maxLogs=32 2023-10-06 04:00:25,845 INFO [RS:1;jenkins-hbase4:38169] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38169%2C1696564824132, suffix=, logDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/WALs/jenkins-hbase4.apache.org,38169,1696564824132, archiveDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/oldWALs, maxLogs=32 2023-10-06 04:00:25,873 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45593,DS-198766ca-f627-48f0-9f63-5926e2726f36,DISK] 2023-10-06 04:00:25,873 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34459,DS-97309f9d-4219-4545-b1f2-33871c6e884f,DISK] 2023-10-06 04:00:25,874 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38183,DS-2f85b671-af49-4ca1-88f6-59570244b916,DISK] 2023-10-06 04:00:25,889 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38183,DS-2f85b671-af49-4ca1-88f6-59570244b916,DISK] 2023-10-06 04:00:25,889 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34459,DS-97309f9d-4219-4545-b1f2-33871c6e884f,DISK] 2023-10-06 04:00:25,889 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45593,DS-198766ca-f627-48f0-9f63-5926e2726f36,DISK] 2023-10-06 04:00:25,891 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45593,DS-198766ca-f627-48f0-9f63-5926e2726f36,DISK] 2023-10-06 04:00:25,892 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38183,DS-2f85b671-af49-4ca1-88f6-59570244b916,DISK] 2023-10-06 04:00:25,893 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34459,DS-97309f9d-4219-4545-b1f2-33871c6e884f,DISK] 2023-10-06 04:00:25,894 INFO [RS:1;jenkins-hbase4:38169] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/WALs/jenkins-hbase4.apache.org,38169,1696564824132/jenkins-hbase4.apache.org%2C38169%2C1696564824132.1696564825851 2023-10-06 04:00:25,901 DEBUG [RS:1;jenkins-hbase4:38169] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45593,DS-198766ca-f627-48f0-9f63-5926e2726f36,DISK], DatanodeInfoWithStorage[127.0.0.1:38183,DS-2f85b671-af49-4ca1-88f6-59570244b916,DISK], DatanodeInfoWithStorage[127.0.0.1:34459,DS-97309f9d-4219-4545-b1f2-33871c6e884f,DISK]] 2023-10-06 04:00:25,906 INFO [RS:2;jenkins-hbase4:36359] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/WALs/jenkins-hbase4.apache.org,36359,1696564824167/jenkins-hbase4.apache.org%2C36359%2C1696564824167.1696564825851 2023-10-06 04:00:25,907 INFO [RS:0;jenkins-hbase4:36351] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/WALs/jenkins-hbase4.apache.org,36351,1696564824083/jenkins-hbase4.apache.org%2C36351%2C1696564824083.1696564825851 2023-10-06 04:00:25,909 DEBUG [RS:2;jenkins-hbase4:36359] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34459,DS-97309f9d-4219-4545-b1f2-33871c6e884f,DISK], DatanodeInfoWithStorage[127.0.0.1:45593,DS-198766ca-f627-48f0-9f63-5926e2726f36,DISK], DatanodeInfoWithStorage[127.0.0.1:38183,DS-2f85b671-af49-4ca1-88f6-59570244b916,DISK]] 2023-10-06 04:00:25,909 DEBUG [RS:0;jenkins-hbase4:36351] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34459,DS-97309f9d-4219-4545-b1f2-33871c6e884f,DISK], DatanodeInfoWithStorage[127.0.0.1:38183,DS-2f85b671-af49-4ca1-88f6-59570244b916,DISK], DatanodeInfoWithStorage[127.0.0.1:45593,DS-198766ca-f627-48f0-9f63-5926e2726f36,DISK]] 2023-10-06 04:00:25,931 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:25,933 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-06 04:00:25,936 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55664, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-06 04:00:25,948 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-10-06 04:00:25,948 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-06 04:00:25,952 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36351%2C1696564824083.meta, suffix=.meta, logDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/WALs/jenkins-hbase4.apache.org,36351,1696564824083, archiveDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/oldWALs, maxLogs=32 2023-10-06 04:00:25,973 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45593,DS-198766ca-f627-48f0-9f63-5926e2726f36,DISK] 2023-10-06 04:00:25,975 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34459,DS-97309f9d-4219-4545-b1f2-33871c6e884f,DISK] 2023-10-06 04:00:25,976 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38183,DS-2f85b671-af49-4ca1-88f6-59570244b916,DISK] 2023-10-06 04:00:25,984 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/WALs/jenkins-hbase4.apache.org,36351,1696564824083/jenkins-hbase4.apache.org%2C36351%2C1696564824083.meta.1696564825953.meta 2023-10-06 04:00:25,985 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45593,DS-198766ca-f627-48f0-9f63-5926e2726f36,DISK], DatanodeInfoWithStorage[127.0.0.1:34459,DS-97309f9d-4219-4545-b1f2-33871c6e884f,DISK], DatanodeInfoWithStorage[127.0.0.1:38183,DS-2f85b671-af49-4ca1-88f6-59570244b916,DISK]] 2023-10-06 04:00:25,985 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-10-06 04:00:25,986 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-10-06 04:00:25,987 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 04:00:25,988 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-10-06 04:00:25,990 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-10-06 04:00:25,992 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-10-06 04:00:26,004 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-10-06 04:00:26,005 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:00:26,005 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-10-06 04:00:26,005 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-10-06 04:00:26,008 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-06 04:00:26,010 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/meta/1588230740/info 2023-10-06 04:00:26,010 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/meta/1588230740/info 2023-10-06 04:00:26,011 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-06 04:00:26,012 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 04:00:26,012 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-06 04:00:26,014 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/meta/1588230740/rep_barrier 2023-10-06 04:00:26,014 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/meta/1588230740/rep_barrier 2023-10-06 04:00:26,014 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-06 04:00:26,015 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 04:00:26,015 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-06 04:00:26,017 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/meta/1588230740/table 2023-10-06 04:00:26,017 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/meta/1588230740/table 2023-10-06 04:00:26,017 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-06 04:00:26,018 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 04:00:26,020 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/meta/1588230740 2023-10-06 04:00:26,023 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/meta/1588230740 2023-10-06 04:00:26,029 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-06 04:00:26,031 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-06 04:00:26,033 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64330158, jitterRate=-0.041405946016311646}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-06 04:00:26,036 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-06 04:00:26,045 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1696564825922 2023-10-06 04:00:26,062 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-10-06 04:00:26,063 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-10-06 04:00:26,064 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36351,1696564824083, state=OPEN 2023-10-06 04:00:26,067 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-10-06 04:00:26,067 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-06 04:00:26,072 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-10-06 04:00:26,072 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36351,1696564824083 in 330 msec 2023-10-06 04:00:26,077 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-10-06 04:00:26,078 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 542 msec 2023-10-06 04:00:26,084 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 796 msec 2023-10-06 04:00:26,084 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1696564826084, completionTime=-1 2023-10-06 04:00:26,085 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-10-06 04:00:26,085 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-10-06 04:00:26,157 DEBUG [hconnection-0x76348612-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 04:00:26,160 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55678, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 04:00:26,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-10-06 04:00:26,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1696564886181 2023-10-06 04:00:26,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1696564946181 2023-10-06 04:00:26,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 96 msec 2023-10-06 04:00:26,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45627,1696564822800-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-06 04:00:26,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45627,1696564822800-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-06 04:00:26,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45627,1696564822800-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-06 04:00:26,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:45627, period=300000, unit=MILLISECONDS is enabled. 2023-10-06 04:00:26,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-10-06 04:00:26,217 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-10-06 04:00:26,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-10-06 04:00:26,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-06 04:00:26,238 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-10-06 04:00:26,241 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-10-06 04:00:26,244 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-06 04:00:26,267 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/hbase/namespace/cadbe3dac6dec55465caf381df39210e 2023-10-06 04:00:26,270 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/hbase/namespace/cadbe3dac6dec55465caf381df39210e empty. 2023-10-06 04:00:26,271 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/hbase/namespace/cadbe3dac6dec55465caf381df39210e 2023-10-06 04:00:26,271 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-10-06 04:00:26,311 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-10-06 04:00:26,313 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => cadbe3dac6dec55465caf381df39210e, NAME => 'hbase:namespace,,1696564826226.cadbe3dac6dec55465caf381df39210e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp 2023-10-06 04:00:26,331 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696564826226.cadbe3dac6dec55465caf381df39210e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:00:26,332 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing cadbe3dac6dec55465caf381df39210e, disabling compactions & flushes 2023-10-06 04:00:26,332 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696564826226.cadbe3dac6dec55465caf381df39210e. 2023-10-06 04:00:26,332 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696564826226.cadbe3dac6dec55465caf381df39210e. 2023-10-06 04:00:26,332 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696564826226.cadbe3dac6dec55465caf381df39210e. after waiting 0 ms 2023-10-06 04:00:26,332 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696564826226.cadbe3dac6dec55465caf381df39210e. 2023-10-06 04:00:26,332 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696564826226.cadbe3dac6dec55465caf381df39210e. 2023-10-06 04:00:26,332 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for cadbe3dac6dec55465caf381df39210e: 2023-10-06 04:00:26,338 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-10-06 04:00:26,352 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1696564826226.cadbe3dac6dec55465caf381df39210e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696564826341"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696564826341"}]},"ts":"1696564826341"} 2023-10-06 04:00:26,379 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-06 04:00:26,380 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-06 04:00:26,385 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696564826381"}]},"ts":"1696564826381"} 2023-10-06 04:00:26,388 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-10-06 04:00:26,393 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-06 04:00:26,394 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-06 04:00:26,394 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-06 04:00:26,394 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-06 04:00:26,394 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-06 04:00:26,396 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=cadbe3dac6dec55465caf381df39210e, ASSIGN}] 2023-10-06 04:00:26,399 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=cadbe3dac6dec55465caf381df39210e, ASSIGN 2023-10-06 04:00:26,401 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=cadbe3dac6dec55465caf381df39210e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36351,1696564824083; forceNewPlan=false, retain=false 2023-10-06 04:00:26,553 INFO [jenkins-hbase4:45627] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-06 04:00:26,554 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=cadbe3dac6dec55465caf381df39210e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:26,554 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1696564826226.cadbe3dac6dec55465caf381df39210e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696564826554"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696564826554"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696564826554"}]},"ts":"1696564826554"} 2023-10-06 04:00:26,559 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure cadbe3dac6dec55465caf381df39210e, server=jenkins-hbase4.apache.org,36351,1696564824083}] 2023-10-06 04:00:26,722 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1696564826226.cadbe3dac6dec55465caf381df39210e. 2023-10-06 04:00:26,723 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cadbe3dac6dec55465caf381df39210e, NAME => 'hbase:namespace,,1696564826226.cadbe3dac6dec55465caf381df39210e.', STARTKEY => '', ENDKEY => ''} 2023-10-06 04:00:26,724 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1696564826226.cadbe3dac6dec55465caf381df39210e. service=AccessControlService 2023-10-06 04:00:26,725 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 04:00:26,725 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace cadbe3dac6dec55465caf381df39210e 2023-10-06 04:00:26,725 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696564826226.cadbe3dac6dec55465caf381df39210e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:00:26,725 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cadbe3dac6dec55465caf381df39210e 2023-10-06 04:00:26,725 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cadbe3dac6dec55465caf381df39210e 2023-10-06 04:00:26,728 INFO [StoreOpener-cadbe3dac6dec55465caf381df39210e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region cadbe3dac6dec55465caf381df39210e 2023-10-06 04:00:26,730 DEBUG [StoreOpener-cadbe3dac6dec55465caf381df39210e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/namespace/cadbe3dac6dec55465caf381df39210e/info 2023-10-06 04:00:26,730 DEBUG [StoreOpener-cadbe3dac6dec55465caf381df39210e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/namespace/cadbe3dac6dec55465caf381df39210e/info 2023-10-06 04:00:26,731 INFO [StoreOpener-cadbe3dac6dec55465caf381df39210e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cadbe3dac6dec55465caf381df39210e columnFamilyName info 2023-10-06 04:00:26,731 INFO [StoreOpener-cadbe3dac6dec55465caf381df39210e-1] regionserver.HStore(310): Store=cadbe3dac6dec55465caf381df39210e/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 04:00:26,733 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/namespace/cadbe3dac6dec55465caf381df39210e 2023-10-06 04:00:26,734 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/namespace/cadbe3dac6dec55465caf381df39210e 2023-10-06 04:00:26,739 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cadbe3dac6dec55465caf381df39210e 2023-10-06 04:00:26,742 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/namespace/cadbe3dac6dec55465caf381df39210e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 04:00:26,743 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cadbe3dac6dec55465caf381df39210e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64591395, jitterRate=-0.037513211369514465}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 04:00:26,743 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cadbe3dac6dec55465caf381df39210e: 2023-10-06 04:00:26,745 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1696564826226.cadbe3dac6dec55465caf381df39210e., pid=6, masterSystemTime=1696564826713 2023-10-06 04:00:26,748 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1696564826226.cadbe3dac6dec55465caf381df39210e. 2023-10-06 04:00:26,749 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1696564826226.cadbe3dac6dec55465caf381df39210e. 2023-10-06 04:00:26,750 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=cadbe3dac6dec55465caf381df39210e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:26,750 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1696564826226.cadbe3dac6dec55465caf381df39210e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696564826749"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696564826749"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696564826749"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696564826749"}]},"ts":"1696564826749"} 2023-10-06 04:00:26,759 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-10-06 04:00:26,759 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure cadbe3dac6dec55465caf381df39210e, server=jenkins-hbase4.apache.org,36351,1696564824083 in 196 msec 2023-10-06 04:00:26,762 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-10-06 04:00:26,763 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=cadbe3dac6dec55465caf381df39210e, ASSIGN in 363 msec 2023-10-06 04:00:26,764 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-06 04:00:26,764 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696564826764"}]},"ts":"1696564826764"} 2023-10-06 04:00:26,766 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-10-06 04:00:26,770 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-10-06 04:00:26,773 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 542 msec 2023-10-06 04:00:26,842 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-10-06 04:00:26,843 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-10-06 04:00:26,843 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-06 04:00:26,881 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-10-06 04:00:26,897 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-06 04:00:26,903 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 31 msec 2023-10-06 04:00:26,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-10-06 04:00:26,926 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-06 04:00:26,932 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-10-06 04:00:26,941 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-10-06 04:00:26,944 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-10-06 04:00:26,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.707sec 2023-10-06 04:00:26,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-10-06 04:00:26,949 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-10-06 04:00:26,949 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-10-06 04:00:26,951 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45627,1696564822800-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-10-06 04:00:26,951 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45627,1696564822800-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-10-06 04:00:26,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-06 04:00:26,974 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-10-06 04:00:26,977 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-10-06 04:00:26,978 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-06 04:00:26,981 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/hbase/acl/1e60c9d8dbb04b6f73f7e208587d1391 2023-10-06 04:00:26,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-10-06 04:00:26,982 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/hbase/acl/1e60c9d8dbb04b6f73f7e208587d1391 empty. 2023-10-06 04:00:26,985 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/hbase/acl/1e60c9d8dbb04b6f73f7e208587d1391 2023-10-06 04:00:26,985 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-10-06 04:00:26,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-06 04:00:27,001 DEBUG [Listener at localhost/37595] zookeeper.ReadOnlyZKClient(139): Connect 0x6de5d2cc to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 04:00:27,009 DEBUG [Listener at localhost/37595] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23ecf83a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 04:00:27,017 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-10-06 04:00:27,021 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1e60c9d8dbb04b6f73f7e208587d1391, NAME => 'hbase:acl,,1696564826968.1e60c9d8dbb04b6f73f7e208587d1391.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp 2023-10-06 04:00:27,025 DEBUG [hconnection-0x1ad58a37-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 04:00:27,047 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55692, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 04:00:27,051 INFO [Listener at localhost/37595] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,45627,1696564822800 2023-10-06 04:00:27,052 INFO [Listener at localhost/37595] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-10-06 04:00:27,052 INFO [Listener at localhost/37595] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/test.cache.data in system properties and HBase conf 2023-10-06 04:00:27,052 INFO [Listener at localhost/37595] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/hadoop.tmp.dir in system properties and HBase conf 2023-10-06 04:00:27,052 INFO [Listener at localhost/37595] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/hadoop.log.dir in system properties and HBase conf 2023-10-06 04:00:27,052 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696564826968.1e60c9d8dbb04b6f73f7e208587d1391.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:00:27,052 INFO [Listener at localhost/37595] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-06 04:00:27,052 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 1e60c9d8dbb04b6f73f7e208587d1391, disabling compactions & flushes 2023-10-06 04:00:27,053 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696564826968.1e60c9d8dbb04b6f73f7e208587d1391. 2023-10-06 04:00:27,053 INFO [Listener at localhost/37595] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-06 04:00:27,053 INFO [Listener at localhost/37595] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-06 04:00:27,053 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696564826968.1e60c9d8dbb04b6f73f7e208587d1391. 2023-10-06 04:00:27,053 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696564826968.1e60c9d8dbb04b6f73f7e208587d1391. after waiting 0 ms 2023-10-06 04:00:27,053 INFO [Listener at localhost/37595] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-06 04:00:27,053 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696564826968.1e60c9d8dbb04b6f73f7e208587d1391. 2023-10-06 04:00:27,053 INFO [Listener at localhost/37595] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-06 04:00:27,053 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1696564826968.1e60c9d8dbb04b6f73f7e208587d1391. 2023-10-06 04:00:27,053 INFO [Listener at localhost/37595] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-06 04:00:27,053 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 1e60c9d8dbb04b6f73f7e208587d1391: 2023-10-06 04:00:27,053 INFO [Listener at localhost/37595] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-06 04:00:27,053 INFO [Listener at localhost/37595] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-06 04:00:27,054 INFO [Listener at localhost/37595] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-06 04:00:27,054 INFO [Listener at localhost/37595] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-06 04:00:27,054 INFO [Listener at localhost/37595] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-06 04:00:27,054 INFO [Listener at localhost/37595] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-06 04:00:27,054 INFO [Listener at localhost/37595] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/nfs.dump.dir in system properties and HBase conf 2023-10-06 04:00:27,054 INFO [Listener at localhost/37595] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/java.io.tmpdir in system properties and HBase conf 2023-10-06 04:00:27,054 INFO [Listener at localhost/37595] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-06 04:00:27,055 INFO [Listener at localhost/37595] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-06 04:00:27,055 INFO [Listener at localhost/37595] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-10-06 04:00:27,058 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-10-06 04:00:27,059 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1696564826968.1e60c9d8dbb04b6f73f7e208587d1391.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696564827059"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696564827059"}]},"ts":"1696564827059"} 2023-10-06 04:00:27,062 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-06 04:00:27,064 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-06 04:00:27,064 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696564827064"}]},"ts":"1696564827064"} 2023-10-06 04:00:27,067 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-10-06 04:00:27,072 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-06 04:00:27,073 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-06 04:00:27,073 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-06 04:00:27,073 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-06 04:00:27,073 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-06 04:00:27,073 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=1e60c9d8dbb04b6f73f7e208587d1391, ASSIGN}] 2023-10-06 04:00:27,076 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=1e60c9d8dbb04b6f73f7e208587d1391, ASSIGN 2023-10-06 04:00:27,078 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=1e60c9d8dbb04b6f73f7e208587d1391, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36351,1696564824083; forceNewPlan=false, retain=false 2023-10-06 04:00:27,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-06 04:00:27,228 INFO [jenkins-hbase4:45627] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-06 04:00:27,229 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=1e60c9d8dbb04b6f73f7e208587d1391, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:27,230 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1696564826968.1e60c9d8dbb04b6f73f7e208587d1391.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696564827229"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696564827229"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696564827229"}]},"ts":"1696564827229"} 2023-10-06 04:00:27,233 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 1e60c9d8dbb04b6f73f7e208587d1391, server=jenkins-hbase4.apache.org,36351,1696564824083}] 2023-10-06 04:00:27,294 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-06 04:00:27,393 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1696564826968.1e60c9d8dbb04b6f73f7e208587d1391. 2023-10-06 04:00:27,393 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1e60c9d8dbb04b6f73f7e208587d1391, NAME => 'hbase:acl,,1696564826968.1e60c9d8dbb04b6f73f7e208587d1391.', STARTKEY => '', ENDKEY => ''} 2023-10-06 04:00:27,394 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1696564826968.1e60c9d8dbb04b6f73f7e208587d1391. service=AccessControlService 2023-10-06 04:00:27,394 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 04:00:27,394 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 1e60c9d8dbb04b6f73f7e208587d1391 2023-10-06 04:00:27,394 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696564826968.1e60c9d8dbb04b6f73f7e208587d1391.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:00:27,394 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1e60c9d8dbb04b6f73f7e208587d1391 2023-10-06 04:00:27,394 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1e60c9d8dbb04b6f73f7e208587d1391 2023-10-06 04:00:27,397 INFO [StoreOpener-1e60c9d8dbb04b6f73f7e208587d1391-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 1e60c9d8dbb04b6f73f7e208587d1391 2023-10-06 04:00:27,399 DEBUG [StoreOpener-1e60c9d8dbb04b6f73f7e208587d1391-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/acl/1e60c9d8dbb04b6f73f7e208587d1391/l 2023-10-06 04:00:27,399 DEBUG [StoreOpener-1e60c9d8dbb04b6f73f7e208587d1391-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/acl/1e60c9d8dbb04b6f73f7e208587d1391/l 2023-10-06 04:00:27,399 INFO [StoreOpener-1e60c9d8dbb04b6f73f7e208587d1391-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e60c9d8dbb04b6f73f7e208587d1391 columnFamilyName l 2023-10-06 04:00:27,400 INFO [StoreOpener-1e60c9d8dbb04b6f73f7e208587d1391-1] regionserver.HStore(310): Store=1e60c9d8dbb04b6f73f7e208587d1391/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 04:00:27,402 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/acl/1e60c9d8dbb04b6f73f7e208587d1391 2023-10-06 04:00:27,404 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/acl/1e60c9d8dbb04b6f73f7e208587d1391 2023-10-06 04:00:27,408 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1e60c9d8dbb04b6f73f7e208587d1391 2023-10-06 04:00:27,412 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/acl/1e60c9d8dbb04b6f73f7e208587d1391/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 04:00:27,414 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1e60c9d8dbb04b6f73f7e208587d1391; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72826153, jitterRate=0.08519424498081207}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 04:00:27,415 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1e60c9d8dbb04b6f73f7e208587d1391: 2023-10-06 04:00:27,416 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1696564826968.1e60c9d8dbb04b6f73f7e208587d1391., pid=11, masterSystemTime=1696564827387 2023-10-06 04:00:27,419 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1696564826968.1e60c9d8dbb04b6f73f7e208587d1391. 2023-10-06 04:00:27,419 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1696564826968.1e60c9d8dbb04b6f73f7e208587d1391. 2023-10-06 04:00:27,420 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=1e60c9d8dbb04b6f73f7e208587d1391, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:27,420 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1696564826968.1e60c9d8dbb04b6f73f7e208587d1391.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696564827420"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696564827420"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696564827420"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696564827420"}]},"ts":"1696564827420"} 2023-10-06 04:00:27,429 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-10-06 04:00:27,429 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 1e60c9d8dbb04b6f73f7e208587d1391, server=jenkins-hbase4.apache.org,36351,1696564824083 in 191 msec 2023-10-06 04:00:27,433 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-10-06 04:00:27,434 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=1e60c9d8dbb04b6f73f7e208587d1391, ASSIGN in 356 msec 2023-10-06 04:00:27,435 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-06 04:00:27,435 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696564827435"}]},"ts":"1696564827435"} 2023-10-06 04:00:27,438 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-10-06 04:00:27,441 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-10-06 04:00:27,444 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 468 msec 2023-10-06 04:00:27,594 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-06 04:00:27,595 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-10-06 04:00:27,604 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-10-06 04:00:28,145 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-06 04:00:28,443 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-10-06 04:00:28,448 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37277_jobhistory____.txh4mh/webapp 2023-10-06 04:00:28,595 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-10-06 04:00:28,595 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-10-06 04:00:28,595 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-06 04:00:28,598 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-06 04:00:28,665 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-06 04:00:28,930 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-06 04:00:29,207 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-10-06 04:00:29,230 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37277 2023-10-06 04:00:29,637 WARN [Listener at jenkins-hbase4.apache.org/42421] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-06 04:00:29,900 WARN [Listener at jenkins-hbase4.apache.org/42421] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-06 04:00:29,901 INFO [Listener at jenkins-hbase4.apache.org/42421] log.Slf4jLog(67): jetty-6.1.26 2023-10-06 04:00:29,906 INFO [Listener at jenkins-hbase4.apache.org/42421] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_36909_cluster____.26qnwb/webapp 2023-10-06 04:00:29,972 INFO [Listener at jenkins-hbase4.apache.org/42421] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-10-06 04:00:29,973 INFO [Listener at jenkins-hbase4.apache.org/42421] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-10-06 04:00:29,973 INFO [Listener at jenkins-hbase4.apache.org/42421] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-06 04:00:29,973 INFO [Listener at jenkins-hbase4.apache.org/42421] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-06 04:00:29,981 INFO [Listener at jenkins-hbase4.apache.org/42421] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-06 04:00:30,172 INFO [Listener at jenkins-hbase4.apache.org/42421] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-06 04:00:30,295 INFO [Listener at jenkins-hbase4.apache.org/42421] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-06 04:00:30,304 INFO [Listener at jenkins-hbase4.apache.org/42421] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:36909 2023-10-06 04:00:30,723 WARN [Listener at jenkins-hbase4.apache.org/37537] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-06 04:00:30,747 WARN [Listener at jenkins-hbase4.apache.org/37537] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-06 04:00:30,748 INFO [Listener at jenkins-hbase4.apache.org/37537] log.Slf4jLog(67): jetty-6.1.26 2023-10-06 04:00:30,753 INFO [Listener at jenkins-hbase4.apache.org/37537] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_36737_node____.7cya0a/webapp 2023-10-06 04:00:30,807 INFO [Listener at jenkins-hbase4.apache.org/37537] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-06 04:00:30,807 INFO [Listener at jenkins-hbase4.apache.org/37537] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-06 04:00:30,807 INFO [Listener at jenkins-hbase4.apache.org/37537] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-06 04:00:30,807 INFO [Listener at jenkins-hbase4.apache.org/37537] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-06 04:00:30,816 INFO [Listener at jenkins-hbase4.apache.org/37537] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-06 04:00:30,837 INFO [Listener at jenkins-hbase4.apache.org/37537] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-06 04:00:30,908 INFO [Listener at jenkins-hbase4.apache.org/37537] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-06 04:00:30,918 INFO [Listener at jenkins-hbase4.apache.org/37537] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:36737 2023-10-06 04:00:31,120 WARN [Listener at jenkins-hbase4.apache.org/34869] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-06 04:00:31,126 WARN [Listener at jenkins-hbase4.apache.org/34869] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-06 04:00:31,127 INFO [Listener at jenkins-hbase4.apache.org/34869] log.Slf4jLog(67): jetty-6.1.26 2023-10-06 04:00:31,132 INFO [Listener at jenkins-hbase4.apache.org/34869] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43377_node____g84p82/webapp 2023-10-06 04:00:31,180 INFO [Listener at jenkins-hbase4.apache.org/34869] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-06 04:00:31,181 INFO [Listener at jenkins-hbase4.apache.org/34869] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-06 04:00:31,181 INFO [Listener at jenkins-hbase4.apache.org/34869] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-06 04:00:31,181 INFO [Listener at jenkins-hbase4.apache.org/34869] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-06 04:00:31,188 INFO [Listener at jenkins-hbase4.apache.org/34869] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-06 04:00:31,199 INFO [Listener at jenkins-hbase4.apache.org/34869] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-06 04:00:31,271 INFO [Listener at jenkins-hbase4.apache.org/34869] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-06 04:00:31,278 INFO [Listener at jenkins-hbase4.apache.org/34869] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43377 2023-10-06 04:00:31,301 INFO [Listener at jenkins-hbase4.apache.org/34869] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-10-06 04:00:31,302 INFO [Listener at jenkins-hbase4.apache.org/34869] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 04:00:31,362 INFO [Listener at jenkins-hbase4.apache.org/34869] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=704, OpenFileDescriptor=899, MaxFileDescriptor=60000, SystemLoadAverage=259, ProcessCount=165, AvailableMemoryMB=6868 2023-10-06 04:00:31,363 WARN [Listener at jenkins-hbase4.apache.org/34869] hbase.ResourceChecker(130): Thread=704 is superior to 500 2023-10-06 04:00:31,376 DEBUG [Listener at jenkins-hbase4.apache.org/34869] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-06 04:00:31,381 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41992, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-06 04:00:31,388 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-06 04:00:31,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-10-06 04:00:31,393 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-10-06 04:00:31,394 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-10-06 04:00:31,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-06 04:00:31,396 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-06 04:00:31,400 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportWithTargetName/c6ac6f6e2dc3277b97378115c50429a7 2023-10-06 04:00:31,400 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportWithTargetName/4992c2e1c7889d754661be9d9db9279b 2023-10-06 04:00:31,401 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportWithTargetName/c6ac6f6e2dc3277b97378115c50429a7 empty. 2023-10-06 04:00:31,401 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportWithTargetName/4992c2e1c7889d754661be9d9db9279b empty. 2023-10-06 04:00:31,403 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportWithTargetName/c6ac6f6e2dc3277b97378115c50429a7 2023-10-06 04:00:31,404 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportWithTargetName/4992c2e1c7889d754661be9d9db9279b 2023-10-06 04:00:31,404 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-06 04:00:31,433 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-10-06 04:00:31,435 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4992c2e1c7889d754661be9d9db9279b, NAME => 'testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp 2023-10-06 04:00:31,435 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => c6ac6f6e2dc3277b97378115c50429a7, NAME => 'testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp 2023-10-06 04:00:31,468 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:00:31,468 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing c6ac6f6e2dc3277b97378115c50429a7, disabling compactions & flushes 2023-10-06 04:00:31,468 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:00:31,468 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7. 2023-10-06 04:00:31,469 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 4992c2e1c7889d754661be9d9db9279b, disabling compactions & flushes 2023-10-06 04:00:31,469 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7. 2023-10-06 04:00:31,469 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b. 2023-10-06 04:00:31,469 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7. after waiting 0 ms 2023-10-06 04:00:31,469 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7. 2023-10-06 04:00:31,469 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b. 2023-10-06 04:00:31,469 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7. 2023-10-06 04:00:31,469 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b. after waiting 0 ms 2023-10-06 04:00:31,469 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for c6ac6f6e2dc3277b97378115c50429a7: 2023-10-06 04:00:31,469 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b. 2023-10-06 04:00:31,469 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b. 2023-10-06 04:00:31,469 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 4992c2e1c7889d754661be9d9db9279b: 2023-10-06 04:00:31,473 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-10-06 04:00:31,474 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696564831474"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696564831474"}]},"ts":"1696564831474"} 2023-10-06 04:00:31,474 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696564831474"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696564831474"}]},"ts":"1696564831474"} 2023-10-06 04:00:31,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-06 04:00:31,526 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-06 04:00:31,527 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-06 04:00:31,527 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696564831527"}]},"ts":"1696564831527"} 2023-10-06 04:00:31,529 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-10-06 04:00:31,534 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-06 04:00:31,536 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-06 04:00:31,536 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-06 04:00:31,536 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-06 04:00:31,536 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-06 04:00:31,536 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c6ac6f6e2dc3277b97378115c50429a7, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4992c2e1c7889d754661be9d9db9279b, ASSIGN}] 2023-10-06 04:00:31,539 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c6ac6f6e2dc3277b97378115c50429a7, ASSIGN 2023-10-06 04:00:31,539 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4992c2e1c7889d754661be9d9db9279b, ASSIGN 2023-10-06 04:00:31,541 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c6ac6f6e2dc3277b97378115c50429a7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36359,1696564824167; forceNewPlan=false, retain=false 2023-10-06 04:00:31,541 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4992c2e1c7889d754661be9d9db9279b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38169,1696564824132; forceNewPlan=false, retain=false 2023-10-06 04:00:31,563 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-06 04:00:31,691 INFO [jenkins-hbase4:45627] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-06 04:00:31,693 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=4992c2e1c7889d754661be9d9db9279b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:31,693 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=c6ac6f6e2dc3277b97378115c50429a7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:31,693 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696564831693"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696564831693"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696564831693"}]},"ts":"1696564831693"} 2023-10-06 04:00:31,693 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696564831693"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696564831693"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696564831693"}]},"ts":"1696564831693"} 2023-10-06 04:00:31,696 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 4992c2e1c7889d754661be9d9db9279b, server=jenkins-hbase4.apache.org,38169,1696564824132}] 2023-10-06 04:00:31,698 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure c6ac6f6e2dc3277b97378115c50429a7, server=jenkins-hbase4.apache.org,36359,1696564824167}] 2023-10-06 04:00:31,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-06 04:00:31,712 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-10-06 04:00:31,713 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-10-06 04:00:31,714 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-10-06 04:00:31,852 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:31,852 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:31,852 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-06 04:00:31,852 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-06 04:00:31,857 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57460, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-06 04:00:31,857 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40688, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-06 04:00:31,866 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b. 2023-10-06 04:00:31,866 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7. 2023-10-06 04:00:31,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4992c2e1c7889d754661be9d9db9279b, NAME => 'testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b.', STARTKEY => '1', ENDKEY => ''} 2023-10-06 04:00:31,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c6ac6f6e2dc3277b97378115c50429a7, NAME => 'testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7.', STARTKEY => '', ENDKEY => '1'} 2023-10-06 04:00:31,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7. service=AccessControlService 2023-10-06 04:00:31,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b. service=AccessControlService 2023-10-06 04:00:31,867 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 04:00:31,867 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 04:00:31,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName c6ac6f6e2dc3277b97378115c50429a7 2023-10-06 04:00:31,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:00:31,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 4992c2e1c7889d754661be9d9db9279b 2023-10-06 04:00:31,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c6ac6f6e2dc3277b97378115c50429a7 2023-10-06 04:00:31,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:00:31,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c6ac6f6e2dc3277b97378115c50429a7 2023-10-06 04:00:31,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4992c2e1c7889d754661be9d9db9279b 2023-10-06 04:00:31,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4992c2e1c7889d754661be9d9db9279b 2023-10-06 04:00:31,874 INFO [StoreOpener-4992c2e1c7889d754661be9d9db9279b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4992c2e1c7889d754661be9d9db9279b 2023-10-06 04:00:31,874 INFO [StoreOpener-c6ac6f6e2dc3277b97378115c50429a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c6ac6f6e2dc3277b97378115c50429a7 2023-10-06 04:00:31,877 DEBUG [StoreOpener-c6ac6f6e2dc3277b97378115c50429a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportWithTargetName/c6ac6f6e2dc3277b97378115c50429a7/cf 2023-10-06 04:00:31,877 DEBUG [StoreOpener-c6ac6f6e2dc3277b97378115c50429a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportWithTargetName/c6ac6f6e2dc3277b97378115c50429a7/cf 2023-10-06 04:00:31,877 DEBUG [StoreOpener-4992c2e1c7889d754661be9d9db9279b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportWithTargetName/4992c2e1c7889d754661be9d9db9279b/cf 2023-10-06 04:00:31,877 DEBUG [StoreOpener-4992c2e1c7889d754661be9d9db9279b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportWithTargetName/4992c2e1c7889d754661be9d9db9279b/cf 2023-10-06 04:00:31,881 INFO [StoreOpener-4992c2e1c7889d754661be9d9db9279b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4992c2e1c7889d754661be9d9db9279b columnFamilyName cf 2023-10-06 04:00:31,881 INFO [StoreOpener-c6ac6f6e2dc3277b97378115c50429a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c6ac6f6e2dc3277b97378115c50429a7 columnFamilyName cf 2023-10-06 04:00:31,885 INFO [StoreOpener-c6ac6f6e2dc3277b97378115c50429a7-1] regionserver.HStore(310): Store=c6ac6f6e2dc3277b97378115c50429a7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 04:00:31,885 INFO [StoreOpener-4992c2e1c7889d754661be9d9db9279b-1] regionserver.HStore(310): Store=4992c2e1c7889d754661be9d9db9279b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 04:00:31,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportWithTargetName/c6ac6f6e2dc3277b97378115c50429a7 2023-10-06 04:00:31,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportWithTargetName/4992c2e1c7889d754661be9d9db9279b 2023-10-06 04:00:31,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportWithTargetName/c6ac6f6e2dc3277b97378115c50429a7 2023-10-06 04:00:31,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportWithTargetName/4992c2e1c7889d754661be9d9db9279b 2023-10-06 04:00:31,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4992c2e1c7889d754661be9d9db9279b 2023-10-06 04:00:31,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c6ac6f6e2dc3277b97378115c50429a7 2023-10-06 04:00:31,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportWithTargetName/4992c2e1c7889d754661be9d9db9279b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 04:00:31,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportWithTargetName/c6ac6f6e2dc3277b97378115c50429a7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 04:00:31,906 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c6ac6f6e2dc3277b97378115c50429a7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60081959, jitterRate=-0.10470904409885406}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 04:00:31,906 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4992c2e1c7889d754661be9d9db9279b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75463385, jitterRate=0.12449206411838531}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 04:00:31,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c6ac6f6e2dc3277b97378115c50429a7: 2023-10-06 04:00:31,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4992c2e1c7889d754661be9d9db9279b: 2023-10-06 04:00:31,908 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7., pid=16, masterSystemTime=1696564831852 2023-10-06 04:00:31,908 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b., pid=15, masterSystemTime=1696564831852 2023-10-06 04:00:31,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b. 2023-10-06 04:00:31,914 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b. 2023-10-06 04:00:31,915 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=4992c2e1c7889d754661be9d9db9279b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:31,915 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696564831915"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696564831915"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696564831915"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696564831915"}]},"ts":"1696564831915"} 2023-10-06 04:00:31,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7. 2023-10-06 04:00:31,917 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7. 2023-10-06 04:00:31,917 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=c6ac6f6e2dc3277b97378115c50429a7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:31,919 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696564831917"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696564831917"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696564831917"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696564831917"}]},"ts":"1696564831917"} 2023-10-06 04:00:31,924 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-10-06 04:00:31,924 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 4992c2e1c7889d754661be9d9db9279b, server=jenkins-hbase4.apache.org,38169,1696564824132 in 224 msec 2023-10-06 04:00:31,926 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=13 2023-10-06 04:00:31,926 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4992c2e1c7889d754661be9d9db9279b, ASSIGN in 388 msec 2023-10-06 04:00:31,927 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure c6ac6f6e2dc3277b97378115c50429a7, server=jenkins-hbase4.apache.org,36359,1696564824167 in 224 msec 2023-10-06 04:00:31,930 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-10-06 04:00:31,930 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c6ac6f6e2dc3277b97378115c50429a7, ASSIGN in 391 msec 2023-10-06 04:00:31,931 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-06 04:00:31,931 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696564831931"}]},"ts":"1696564831931"} 2023-10-06 04:00:31,933 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-10-06 04:00:31,938 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-10-06 04:00:31,944 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-10-06 04:00:31,961 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36351] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-06 04:00:31,989 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-06 04:00:31,989 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-06 04:00:31,989 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-06 04:00:31,989 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-06 04:00:31,990 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-06 04:00:31,998 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-06 04:00:31,998 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-06 04:00:31,998 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-06 04:00:31,998 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-06 04:00:32,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-06 04:00:32,002 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 610 msec 2023-10-06 04:00:32,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-06 04:00:32,504 INFO [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-10-06 04:00:32,508 DEBUG [Listener at jenkins-hbase4.apache.org/34869] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-06 04:00:32,509 DEBUG [Listener at jenkins-hbase4.apache.org/34869] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7. 2023-10-06 04:00:32,512 INFO [Listener at jenkins-hbase4.apache.org/34869] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 04:00:32,536 DEBUG [hconnection-0x1ad58a37-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 04:00:32,539 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57468, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 04:00:32,543 DEBUG [hconnection-0x1ad58a37-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 04:00:32,547 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40700, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 04:00:32,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-06 04:00:32,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696564832563 (current time:1696564832563). 2023-10-06 04:00:32,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 04:00:32,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(139): Connect 0x300974dc to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 04:00:32,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1248d2d3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 04:00:32,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 04:00:32,575 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55702, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 04:00:32,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x300974dc to 127.0.0.1:57105 2023-10-06 04:00:32,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:00:32,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(139): Connect 0x66512345 to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 04:00:32,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c57f73e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 04:00:32,586 DEBUG [hconnection-0x6627cf8a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 04:00:32,589 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55706, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 04:00:32,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66512345 to 127.0.0.1:57105 2023-10-06 04:00:32,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:00:32,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-06 04:00:32,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 04:00:32,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-06 04:00:32,629 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot, current working dir path: hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 04:00:32,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-06 04:00:32,649 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-06 04:00:32,651 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696565432651 2023-10-06 04:00:32,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-06 04:00:32,651 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-06 04:00:32,654 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-06 04:00:32,655 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-06 04:00:32,656 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 13 msec 2023-10-06 04:00:32,657 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-06 04:00:32,658 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 04:00:32,658 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 04:00:32,658 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696565432658 2023-10-06 04:00:32,683 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,684 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-10-06 04:00:32,684 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:00:32,684 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-10-06 04:00:32,684 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-06 04:00:32,685 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,685 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,691 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:00:32,691 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:00:32,691 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:32,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:00:32,691 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:00:32,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:00:32,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:00:32,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:00:32,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:00:32,691 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:32,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:00:32,691 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:32,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,692 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:32,692 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 04:00:32,692 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,692 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,692 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-06 04:00:32,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-06 04:00:32,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-06 04:00:32,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,694 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-06 04:00:32,694 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-06 04:00:32,694 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-06 04:00:32,697 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,697 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,697 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,697 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-06 04:00:32,697 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:00:32,697 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-06 04:00:32,697 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:00:32,700 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-06 04:00:32,700 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-06 04:00:32,700 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:00:32,700 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-06 04:00:32,700 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-06 04:00:32,700 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36359,1696564824167' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-06 04:00:32,700 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-06 04:00:32,700 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-06 04:00:32,701 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-06 04:00:32,701 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38169,1696564824132' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-06 04:00:32,701 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36351,1696564824083' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-06 04:00:32,703 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:32,703 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:32,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:00:32,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:00:32,704 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:32,704 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,704 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,704 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,704 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:00:32,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:00:32,704 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,704 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:00:32,704 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:00:32,704 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:00:32,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:32,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:32,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:32,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:00:32,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36359,1696564824167' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-06 04:00:32,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@125cd6fd[Count = 1] remaining members to acquire global barrier 2023-10-06 04:00:32,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:32,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:00:32,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:00:32,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:00:32,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:00:32,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:32,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:32,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:32,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:00:32,711 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38169,1696564824132' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-06 04:00:32,711 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@125cd6fd[Count = 0] remaining members to acquire global barrier 2023-10-06 04:00:32,711 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-06 04:00:32,711 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,713 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,713 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,713 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,713 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:32,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,713 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-06 04:00:32,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,714 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-06 04:00:32,714 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-06 04:00:32,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,714 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:32,714 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-06 04:00:32,714 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 04:00:32,714 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36351,1696564824083' in zk 2023-10-06 04:00:32,715 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 04:00:32,715 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 04:00:32,715 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b. 2023-10-06 04:00:32,715 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7. 2023-10-06 04:00:32,715 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 04:00:32,715 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 04:00:32,715 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b. started... 2023-10-06 04:00:32,715 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7. started... 2023-10-06 04:00:32,718 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-06 04:00:32,719 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:00:32,719 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-06 04:00:32,721 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c6ac6f6e2dc3277b97378115c50429a7: 2023-10-06 04:00:32,721 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4992c2e1c7889d754661be9d9db9279b: 2023-10-06 04:00:32,722 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,722 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,727 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 04:00:32,727 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 04:00:32,731 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 04:00:32,731 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 04:00:32,758 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 04:00:32,761 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7. completed. 2023-10-06 04:00:32,761 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7. 2023-10-06 04:00:32,761 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 04:00:32,761 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 04:00:32,761 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:32,761 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-06 04:00:32,761 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36359,1696564824167' in zk 2023-10-06 04:00:32,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-06 04:00:32,764 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:32,764 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-06 04:00:32,764 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:00:32,764 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-06 04:00:32,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-06 04:00:32,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:32,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:00:32,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:00:32,766 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 04:00:32,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:00:32,766 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b. completed. 2023-10-06 04:00:32,766 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b. 2023-10-06 04:00:32,766 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 04:00:32,766 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 04:00:32,766 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:32,766 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-06 04:00:32,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:00:32,767 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38169,1696564824132' in zk 2023-10-06 04:00:32,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:32,768 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:32,768 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-06 04:00:32,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:32,769 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:00:32,769 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-06 04:00:32,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:32,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:00:32,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:32,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:32,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:32,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,36359,1696564824167': 2023-10-06 04:00:32,773 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36359,1696564824167' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-06 04:00:32,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:32,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:00:32,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:00:32,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:00:32,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:00:32,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:32,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:32,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:32,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:00:32,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:32,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:32,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:32,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,38169,1696564824132': 2023-10-06 04:00:32,778 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38169,1696564824132' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-06 04:00:32,778 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-10-06 04:00:32,778 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 04:00:32,778 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 04:00:32,778 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,779 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 04:00:32,784 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,784 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,784 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:00:32,784 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,784 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:00:32,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:00:32,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,784 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:00:32,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,784 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:00:32,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,785 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:32,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:00:32,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:00:32,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:00:32,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:00:32,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:00:32,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:00:32,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:00:32,785 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:32,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,786 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:32,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:00:32,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:32,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:32,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:32,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:00:32,789 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:32,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,789 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:32,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:32,790 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:32,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:32,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:32,804 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:32,804 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,804 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:32,804 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:00:32,804 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:32,804 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:00:32,804 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:00:32,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:00:32,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:00:32,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:00:32,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:00:32,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:00:32,805 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:00:32,804 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:00:32,804 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,805 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,805 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:00:32,805 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-06 04:00:32,805 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:00:32,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:00:32,805 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:00:32,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:00:32,805 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:32,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:00:32,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:00:32,806 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 04:00:32,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:00:32,807 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:00:32,807 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:32,807 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:32,807 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,807 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,808 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-06 04:00:32,829 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,831 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,888 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-06 04:00:32,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,889 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:32,889 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696564832651Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696564832829 (+178 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1696564832829Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1696564832829Writing data manifest for emptySnaptb0-testExportWithTargetName at 1696564832850 (+21 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1696564832876 (+26 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696564832888 (+12 ms) 2023-10-06 04:00:32,891 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-06 04:00:32,893 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 239 msec 2023-10-06 04:00:32,966 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 04:00:32,968 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 04:00:32,968 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-10-06 04:00:32,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-06 04:00:32,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 04:00:32,969 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 04:00:32,969 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-10-06 04:00:32,969 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-06 04:00:32,969 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-10-06 04:00:32,969 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 04:00:32,969 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-10-06 04:00:32,969 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-06 04:00:32,969 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-10-06 04:00:32,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 04:00:32,986 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38169] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 04:00:32,991 DEBUG [Listener at jenkins-hbase4.apache.org/34869] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-06 04:00:32,991 DEBUG [Listener at jenkins-hbase4.apache.org/34869] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7. 2023-10-06 04:00:32,991 INFO [Listener at jenkins-hbase4.apache.org/34869] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 04:00:33,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-06 04:00:33,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696564833007 (current time:1696564833007). 2023-10-06 04:00:33,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 04:00:33,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(139): Connect 0x6aee89d9 to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 04:00:33,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@485ff385, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 04:00:33,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 04:00:33,018 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55714, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 04:00:33,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6aee89d9 to 127.0.0.1:57105 2023-10-06 04:00:33,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:00:33,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(139): Connect 0x509ec46c to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 04:00:33,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ea02fe7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 04:00:33,027 DEBUG [hconnection-0x79d42e6d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 04:00:33,029 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55720, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 04:00:33,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x509ec46c to 127.0.0.1:57105 2023-10-06 04:00:33,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:00:33,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-06 04:00:33,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 04:00:33,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-06 04:00:33,038 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot, current working dir path: hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 04:00:33,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-06 04:00:33,041 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-06 04:00:33,042 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696565433042 2023-10-06 04:00:33,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-06 04:00:33,042 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-06 04:00:33,043 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 04:00:33,044 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 04:00:33,045 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-06 04:00:33,045 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-06 04:00:33,047 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-10-06 04:00:33,047 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-06 04:00:33,048 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696565433048 2023-10-06 04:00:33,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-10-06 04:00:33,067 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-10-06 04:00:33,067 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:00:33,068 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-10-06 04:00:33,068 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-06 04:00:33,068 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,068 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,070 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:33,070 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:00:33,070 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:00:33,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:00:33,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:00:33,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:00:33,070 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:00:33,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:00:33,071 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:33,071 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:33,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:00:33,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:00:33,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,071 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:33,071 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 04:00:33,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,071 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,071 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,072 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-06 04:00:33,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-06 04:00:33,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-06 04:00:33,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,072 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-06 04:00:33,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,072 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-06 04:00:33,072 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-06 04:00:33,072 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-06 04:00:33,076 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-06 04:00:33,076 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-06 04:00:33,076 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-06 04:00:33,076 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:00:33,076 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-06 04:00:33,077 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-06 04:00:33,077 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-06 04:00:33,077 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-06 04:00:33,077 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38169,1696564824132' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-06 04:00:33,076 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:00:33,077 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:00:33,078 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-06 04:00:33,078 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-06 04:00:33,078 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-06 04:00:33,078 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-06 04:00:33,078 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36351,1696564824083' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-06 04:00:33,078 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36359,1696564824167' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-06 04:00:33,080 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,080 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:33,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:33,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:00:33,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:00:33,081 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,081 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:00:33,082 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:33,082 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,084 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,084 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,084 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:00:33,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:00:33,084 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,084 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:00:33,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:00:33,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-06 04:00:33,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:33,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:33,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:33,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:00:33,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38169,1696564824132' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-06 04:00:33,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@92e73e2[Count = 1] remaining members to acquire global barrier 2023-10-06 04:00:33,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:33,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:00:33,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:00:33,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:00:33,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:00:33,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-06 04:00:33,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:33,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:33,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:33,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:00:33,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36359,1696564824167' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-06 04:00:33,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@92e73e2[Count = 0] remaining members to acquire global barrier 2023-10-06 04:00:33,089 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-06 04:00:33,089 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,094 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,094 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,094 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,094 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-06 04:00:33,094 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:33,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,094 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-06 04:00:33,094 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-06 04:00:33,094 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36351,1696564824083' in zk 2023-10-06 04:00:33,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,095 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-06 04:00:33,095 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 04:00:33,095 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 04:00:33,095 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:33,095 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 04:00:33,095 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 04:00:33,095 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 04:00:33,095 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b. 2023-10-06 04:00:33,095 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7. 2023-10-06 04:00:33,095 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7. started... 2023-10-06 04:00:33,095 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b. started... 2023-10-06 04:00:33,095 INFO [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c6ac6f6e2dc3277b97378115c50429a7 1/1 column families, dataSize=132 B heapSize=544 B 2023-10-06 04:00:33,095 INFO [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4992c2e1c7889d754661be9d9db9279b 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-10-06 04:00:33,098 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-06 04:00:33,098 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:00:33,098 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-06 04:00:33,144 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 04:00:33,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-06 04:00:33,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-06 04:00:33,146 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 04:00:33,240 INFO [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231006a465e2b6025442709c5a0c56699516a1 to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231006a465e2b6025442709c5a0c56699516a1 2023-10-06 04:00:33,240 INFO [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023100612634ebcc0b04fe6919a500c4091e1a7 to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100612634ebcc0b04fe6919a500c4091e1a7 2023-10-06 04:00:33,277 INFO [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportWithTargetName/c6ac6f6e2dc3277b97378115c50429a7/.tmp/cf/dfbeaf5333d64b95a243090955476b24 2023-10-06 04:00:33,291 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportWithTargetName/c6ac6f6e2dc3277b97378115c50429a7/.tmp/cf/dfbeaf5333d64b95a243090955476b24 as hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportWithTargetName/c6ac6f6e2dc3277b97378115c50429a7/cf/dfbeaf5333d64b95a243090955476b24 2023-10-06 04:00:33,299 INFO [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportWithTargetName/c6ac6f6e2dc3277b97378115c50429a7/cf/dfbeaf5333d64b95a243090955476b24, entries=2, sequenceid=6, filesize=5.2 K 2023-10-06 04:00:33,302 INFO [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for c6ac6f6e2dc3277b97378115c50429a7 in 206ms, sequenceid=6, compaction requested=false 2023-10-06 04:00:33,302 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-06 04:00:33,302 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c6ac6f6e2dc3277b97378115c50429a7: 2023-10-06 04:00:33,303 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-06 04:00:33,303 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 04:00:33,303 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportWithTargetName/c6ac6f6e2dc3277b97378115c50429a7/cf/dfbeaf5333d64b95a243090955476b24] hfiles 2023-10-06 04:00:33,303 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportWithTargetName/c6ac6f6e2dc3277b97378115c50429a7/cf/dfbeaf5333d64b95a243090955476b24 for snapshot=snaptb0-testExportWithTargetName 2023-10-06 04:00:33,321 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7. completed. 2023-10-06 04:00:33,321 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7. 2023-10-06 04:00:33,321 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 04:00:33,322 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 04:00:33,322 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:33,322 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-06 04:00:33,322 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36359,1696564824167' in zk 2023-10-06 04:00:33,325 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:33,325 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-06 04:00:33,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:33,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:00:33,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:00:33,325 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:00:33,326 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-06 04:00:33,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:00:33,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:00:33,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-06 04:00:33,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:33,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:33,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:33,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:00:33,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-06 04:00:33,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:33,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:33,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,36359,1696564824167': 2023-10-06 04:00:33,331 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36359,1696564824167' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-06 04:00:33,346 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 04:00:33,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-06 04:00:33,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-06 04:00:33,348 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-06 04:00:33,648 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 04:00:33,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-06 04:00:33,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-06 04:00:33,650 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-06 04:00:33,677 INFO [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportWithTargetName/4992c2e1c7889d754661be9d9db9279b/.tmp/cf/ded927c158d943f39ab51234bd38b0a4 2023-10-06 04:00:33,687 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportWithTargetName/4992c2e1c7889d754661be9d9db9279b/.tmp/cf/ded927c158d943f39ab51234bd38b0a4 as hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportWithTargetName/4992c2e1c7889d754661be9d9db9279b/cf/ded927c158d943f39ab51234bd38b0a4 2023-10-06 04:00:33,695 INFO [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportWithTargetName/4992c2e1c7889d754661be9d9db9279b/cf/ded927c158d943f39ab51234bd38b0a4, entries=48, sequenceid=6, filesize=13.0 K 2023-10-06 04:00:33,698 INFO [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 4992c2e1c7889d754661be9d9db9279b in 603ms, sequenceid=6, compaction requested=false 2023-10-06 04:00:33,699 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4992c2e1c7889d754661be9d9db9279b: 2023-10-06 04:00:33,699 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-06 04:00:33,699 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 04:00:33,699 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportWithTargetName/4992c2e1c7889d754661be9d9db9279b/cf/ded927c158d943f39ab51234bd38b0a4] hfiles 2023-10-06 04:00:33,699 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportWithTargetName/4992c2e1c7889d754661be9d9db9279b/cf/ded927c158d943f39ab51234bd38b0a4 for snapshot=snaptb0-testExportWithTargetName 2023-10-06 04:00:33,714 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b. completed. 2023-10-06 04:00:33,714 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b. 2023-10-06 04:00:33,714 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 04:00:33,715 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 04:00:33,715 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:33,715 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-06 04:00:33,715 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38169,1696564824132' in zk 2023-10-06 04:00:33,717 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-06 04:00:33,717 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:33,717 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:00:33,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:33,717 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-06 04:00:33,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:00:33,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:00:33,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:00:33,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:00:33,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-06 04:00:33,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:33,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:33,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:33,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:00:33,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-06 04:00:33,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:33,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:33,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:33,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,38169,1696564824132': 2023-10-06 04:00:33,722 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38169,1696564824132' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-06 04:00:33,722 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-10-06 04:00:33,722 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 04:00:33,723 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 04:00:33,723 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-10-06 04:00:33,723 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 04:00:33,725 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,725 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,725 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:00:33,725 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:00:33,725 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,725 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:00:33,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:00:33,725 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:00:33,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:00:33,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:00:33,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:00:33,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:00:33,726 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:33,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:00:33,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:00:33,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:00:33,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,729 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:33,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-06 04:00:33,730 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:33,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:00:33,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-06 04:00:33,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:33,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:33,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:33,732 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:33,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:00:33,733 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:33,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-06 04:00:33,733 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:33,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:33,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:33,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:33,745 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:33,745 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:00:33,745 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,745 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:00:33,745 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:33,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:00:33,745 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:33,745 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:00:33,745 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:00:33,746 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-10-06 04:00:33,746 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:00:33,746 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-06 04:00:33,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:00:33,746 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:00:33,746 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:00:33,747 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:33,746 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-06 04:00:33,747 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,747 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 04:00:33,747 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:33,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:00:33,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:00:33,746 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:00:33,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:00:33,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:00:33,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:00:33,747 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:33,747 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,747 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:00:33,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:00:33,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:00:33,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:00:33,748 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100612634ebcc0b04fe6919a500c4091e1a7, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231006a465e2b6025442709c5a0c56699516a1] mob files 2023-10-06 04:00:33,748 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100612634ebcc0b04fe6919a500c4091e1a7 2023-10-06 04:00:33,748 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231006a465e2b6025442709c5a0c56699516a1 2023-10-06 04:00:33,763 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-10-06 04:00:33,764 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,802 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,803 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-06 04:00:33,803 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,804 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-06 04:00:33,804 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696564833042Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696564833763 (+721 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1696564833763Loading Region manifests for snaptb0-testExportWithTargetName at 1696564833763Writing data manifest for snaptb0-testExportWithTargetName at 1696564833768 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1696564833791 (+23 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696564833803 (+12 ms) 2023-10-06 04:00:33,806 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-06 04:00:33,809 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 764 msec 2023-10-06 04:00:34,150 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 04:00:34,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-06 04:00:34,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 04:00:34,153 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564834153 2023-10-06 04:00:34,154 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42421, tgtDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564834153, rawTgtDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564834153, srcFsUri=hdfs://localhost:42421, srcDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91 2023-10-06 04:00:34,201 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42421, inputRoot=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91 2023-10-06 04:00:34,201 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1364146663_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564834153, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564834153/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-06 04:00:34,201 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42421, inputRoot=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91, snapshotDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-10-06 04:00:34,219 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564834153/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-06 04:00:34,288 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-06 04:00:34,289 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-06 04:00:34,291 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-06 04:00:34,291 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-06 04:00:34,292 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-06 04:00:34,292 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-06 04:00:34,293 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-06 04:00:34,381 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/hadoop-9033891048043355486.jar 2023-10-06 04:00:34,382 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-06 04:00:34,382 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-06 04:00:34,383 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-06 04:00:34,383 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-06 04:00:34,384 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-06 04:00:34,384 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-06 04:00:34,385 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-06 04:00:34,386 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-06 04:00:34,386 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-06 04:00:34,387 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-06 04:00:34,388 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-06 04:00:34,389 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-06 04:00:34,389 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-06 04:00:34,390 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-06 04:00:34,390 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-06 04:00:34,391 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-06 04:00:34,395 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 04:00:34,396 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 04:00:34,396 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 04:00:34,397 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 04:00:34,397 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 04:00:34,398 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 04:00:34,398 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 04:00:35,586 WARN [Listener at jenkins-hbase4.apache.org/34869] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-06 04:00:35,592 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-10-06 04:00:35,602 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-06 04:00:36,032 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 04:00:36,034 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 04:00:36,186 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696564830351_0001_000001 (auth:SIMPLE) 2023-10-06 04:00:37,381 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-06 04:00:40,497 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696564830351_0001_000001 (auth:SIMPLE) 2023-10-06 04:00:42,737 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696564830351_0001_000001 (auth:SIMPLE) 2023-10-06 04:00:45,435 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696564830351_0001_000001 (auth:SIMPLE) 2023-10-06 04:00:47,414 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-06 04:00:47,418 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-06 04:00:47,432 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-10-06 04:00:47,432 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-06 04:00:47,433 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-06 04:00:47,433 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1023520784_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-06 04:00:47,434 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(367): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-10-06 04:00:47,434 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(367): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-10-06 04:00:47,434 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1023520784_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564834153/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564834153/.hbase-snapshot/testExportWithTargetName 2023-10-06 04:00:47,435 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(367): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564834153/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-10-06 04:00:47,435 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(367): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564834153/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-10-06 04:00:47,449 INFO [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-10-06 04:00:47,454 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-10-06 04:00:47,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-10-06 04:00:47,471 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696564847470"}]},"ts":"1696564847470"} 2023-10-06 04:00:47,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-06 04:00:47,473 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-10-06 04:00:47,475 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-10-06 04:00:47,477 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c6ac6f6e2dc3277b97378115c50429a7, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4992c2e1c7889d754661be9d9db9279b, UNASSIGN}] 2023-10-06 04:00:47,479 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c6ac6f6e2dc3277b97378115c50429a7, UNASSIGN 2023-10-06 04:00:47,479 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4992c2e1c7889d754661be9d9db9279b, UNASSIGN 2023-10-06 04:00:47,481 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=c6ac6f6e2dc3277b97378115c50429a7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:47,481 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=4992c2e1c7889d754661be9d9db9279b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:47,481 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696564847481"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696564847481"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696564847481"}]},"ts":"1696564847481"} 2023-10-06 04:00:47,481 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696564847481"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696564847481"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696564847481"}]},"ts":"1696564847481"} 2023-10-06 04:00:47,483 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure c6ac6f6e2dc3277b97378115c50429a7, server=jenkins-hbase4.apache.org,36359,1696564824167}] 2023-10-06 04:00:47,484 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 4992c2e1c7889d754661be9d9db9279b, server=jenkins-hbase4.apache.org,38169,1696564824132}] 2023-10-06 04:00:47,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-06 04:00:47,645 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4992c2e1c7889d754661be9d9db9279b 2023-10-06 04:00:47,645 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c6ac6f6e2dc3277b97378115c50429a7 2023-10-06 04:00:47,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c6ac6f6e2dc3277b97378115c50429a7, disabling compactions & flushes 2023-10-06 04:00:47,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4992c2e1c7889d754661be9d9db9279b, disabling compactions & flushes 2023-10-06 04:00:47,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7. 2023-10-06 04:00:47,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b. 2023-10-06 04:00:47,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7. 2023-10-06 04:00:47,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b. 2023-10-06 04:00:47,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7. after waiting 0 ms 2023-10-06 04:00:47,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b. after waiting 0 ms 2023-10-06 04:00:47,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b. 2023-10-06 04:00:47,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7. 2023-10-06 04:00:47,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportWithTargetName/4992c2e1c7889d754661be9d9db9279b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 04:00:47,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportWithTargetName/c6ac6f6e2dc3277b97378115c50429a7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 04:00:47,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 04:00:47,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 04:00:47,661 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b. 2023-10-06 04:00:47,661 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7. 2023-10-06 04:00:47,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4992c2e1c7889d754661be9d9db9279b: 2023-10-06 04:00:47,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c6ac6f6e2dc3277b97378115c50429a7: 2023-10-06 04:00:47,664 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c6ac6f6e2dc3277b97378115c50429a7 2023-10-06 04:00:47,664 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=c6ac6f6e2dc3277b97378115c50429a7, regionState=CLOSED 2023-10-06 04:00:47,665 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696564847664"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696564847664"}]},"ts":"1696564847664"} 2023-10-06 04:00:47,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4992c2e1c7889d754661be9d9db9279b 2023-10-06 04:00:47,666 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=4992c2e1c7889d754661be9d9db9279b, regionState=CLOSED 2023-10-06 04:00:47,666 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696564847666"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696564847666"}]},"ts":"1696564847666"} 2023-10-06 04:00:47,671 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-10-06 04:00:47,671 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure c6ac6f6e2dc3277b97378115c50429a7, server=jenkins-hbase4.apache.org,36359,1696564824167 in 185 msec 2023-10-06 04:00:47,672 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-10-06 04:00:47,672 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 4992c2e1c7889d754661be9d9db9279b, server=jenkins-hbase4.apache.org,38169,1696564824132 in 185 msec 2023-10-06 04:00:47,673 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c6ac6f6e2dc3277b97378115c50429a7, UNASSIGN in 194 msec 2023-10-06 04:00:47,675 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=23, resume processing ppid=21 2023-10-06 04:00:47,675 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4992c2e1c7889d754661be9d9db9279b, UNASSIGN in 195 msec 2023-10-06 04:00:47,676 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696564847676"}]},"ts":"1696564847676"} 2023-10-06 04:00:47,678 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-10-06 04:00:47,680 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-10-06 04:00:47,682 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 222 msec 2023-10-06 04:00:47,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-06 04:00:47,775 INFO [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-10-06 04:00:47,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-10-06 04:00:47,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-06 04:00:47,789 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-06 04:00:47,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-10-06 04:00:47,792 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-06 04:00:47,795 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36351] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-10-06 04:00:47,798 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportWithTargetName/c6ac6f6e2dc3277b97378115c50429a7 2023-10-06 04:00:47,798 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportWithTargetName/4992c2e1c7889d754661be9d9db9279b 2023-10-06 04:00:47,799 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-06 04:00:47,799 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-06 04:00:47,799 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-06 04:00:47,799 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-06 04:00:47,800 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:00:47,800 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:00:47,801 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-06 04:00:47,801 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-06 04:00:47,801 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-06 04:00:47,801 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-06 04:00:47,801 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-06 04:00:47,801 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:00:47,801 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:00:47,801 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-06 04:00:47,801 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-06 04:00:47,801 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-06 04:00:47,802 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportWithTargetName/c6ac6f6e2dc3277b97378115c50429a7/cf, FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportWithTargetName/c6ac6f6e2dc3277b97378115c50429a7/recovered.edits] 2023-10-06 04:00:47,802 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportWithTargetName/4992c2e1c7889d754661be9d9db9279b/cf, FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportWithTargetName/4992c2e1c7889d754661be9d9db9279b/recovered.edits] 2023-10-06 04:00:47,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-06 04:00:47,810 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportWithTargetName/c6ac6f6e2dc3277b97378115c50429a7/cf/dfbeaf5333d64b95a243090955476b24 to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testExportWithTargetName/c6ac6f6e2dc3277b97378115c50429a7/cf/dfbeaf5333d64b95a243090955476b24 2023-10-06 04:00:47,811 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportWithTargetName/4992c2e1c7889d754661be9d9db9279b/cf/ded927c158d943f39ab51234bd38b0a4 to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testExportWithTargetName/4992c2e1c7889d754661be9d9db9279b/cf/ded927c158d943f39ab51234bd38b0a4 2023-10-06 04:00:47,815 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportWithTargetName/4992c2e1c7889d754661be9d9db9279b/recovered.edits/9.seqid to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testExportWithTargetName/4992c2e1c7889d754661be9d9db9279b/recovered.edits/9.seqid 2023-10-06 04:00:47,815 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportWithTargetName/c6ac6f6e2dc3277b97378115c50429a7/recovered.edits/9.seqid to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testExportWithTargetName/c6ac6f6e2dc3277b97378115c50429a7/recovered.edits/9.seqid 2023-10-06 04:00:47,816 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportWithTargetName/4992c2e1c7889d754661be9d9db9279b 2023-10-06 04:00:47,816 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportWithTargetName/c6ac6f6e2dc3277b97378115c50429a7 2023-10-06 04:00:47,816 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-06 04:00:47,816 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-06 04:00:47,817 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-10-06 04:00:47,822 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100612634ebcc0b04fe6919a500c4091e1a7 to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100612634ebcc0b04fe6919a500c4091e1a7 2023-10-06 04:00:47,823 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231006a465e2b6025442709c5a0c56699516a1 to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231006a465e2b6025442709c5a0c56699516a1 2023-10-06 04:00:47,824 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-06 04:00:47,827 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-06 04:00:47,847 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-10-06 04:00:47,850 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-10-06 04:00:47,851 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-06 04:00:47,851 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-10-06 04:00:47,852 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696564847851"}]},"ts":"9223372036854775807"} 2023-10-06 04:00:47,852 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696564847851"}]},"ts":"9223372036854775807"} 2023-10-06 04:00:47,854 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-06 04:00:47,854 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c6ac6f6e2dc3277b97378115c50429a7, NAME => 'testtb-testExportWithTargetName,,1696564831388.c6ac6f6e2dc3277b97378115c50429a7.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 4992c2e1c7889d754661be9d9db9279b, NAME => 'testtb-testExportWithTargetName,1,1696564831388.4992c2e1c7889d754661be9d9db9279b.', STARTKEY => '1', ENDKEY => ''}] 2023-10-06 04:00:47,854 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-10-06 04:00:47,854 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696564847854"}]},"ts":"9223372036854775807"} 2023-10-06 04:00:47,856 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-10-06 04:00:47,858 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-06 04:00:47,860 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 77 msec 2023-10-06 04:00:47,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-06 04:00:47,908 INFO [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-10-06 04:00:47,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-10-06 04:00:47,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-10-06 04:00:47,932 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-10-06 04:00:47,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportWithTargetName 2023-10-06 04:00:47,964 INFO [Listener at jenkins-hbase4.apache.org/34869] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=753 (was 704) Potentially hanging thread: IPC Client (32912118) connection to jenkins-hbase4.apache.org/172.31.14.131:41881 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x76348612-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x76348612-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/cluster_452f40ba-4ad6-c109-846f-078298d21c32/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1023520784_17 at /127.0.0.1:32952 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/cluster_452f40ba-4ad6-c109-846f-078298d21c32/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1281 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/cluster_452f40ba-4ad6-c109-846f-078298d21c32/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/cluster_452f40ba-4ad6-c109-846f-078298d21c32/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_621424761_1 at /127.0.0.1:40734 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x76348612-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1023520784_17 at /127.0.0.1:60648 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/cluster_452f40ba-4ad6-c109-846f-078298d21c32/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (32912118) connection to jenkins-hbase4.apache.org/172.31.14.131:40723 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/cluster_452f40ba-4ad6-c109-846f-078298d21c32/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x76348612-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: IPC Client (32912118) connection to jenkins-hbase4.apache.org/172.31.14.131:37537 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1023520784_17 at /127.0.0.1:40762 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_621424761_1 at /127.0.0.1:32932 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=930 (was 899) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=312 (was 259) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=6111 (was 6868) 2023-10-06 04:00:47,965 WARN [Listener at jenkins-hbase4.apache.org/34869] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-10-06 04:00:47,984 INFO [Listener at jenkins-hbase4.apache.org/34869] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=753, OpenFileDescriptor=930, MaxFileDescriptor=60000, SystemLoadAverage=312, ProcessCount=168, AvailableMemoryMB=6110 2023-10-06 04:00:47,984 WARN [Listener at jenkins-hbase4.apache.org/34869] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-10-06 04:00:47,987 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-06 04:00:47,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-10-06 04:00:47,992 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-06 04:00:47,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-10-06 04:00:47,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-06 04:00:47,995 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-06 04:00:47,998 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemState/6c91673b6a076ed72a83a99b2f56fb0b 2023-10-06 04:00:47,998 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemState/6d803f0b94bab480136c07b795ba7781 2023-10-06 04:00:47,998 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemState/6c91673b6a076ed72a83a99b2f56fb0b empty. 2023-10-06 04:00:47,998 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemState/6d803f0b94bab480136c07b795ba7781 empty. 2023-10-06 04:00:47,999 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemState/6c91673b6a076ed72a83a99b2f56fb0b 2023-10-06 04:00:47,999 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemState/6d803f0b94bab480136c07b795ba7781 2023-10-06 04:00:47,999 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-06 04:00:48,011 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-06 04:00:48,013 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6d803f0b94bab480136c07b795ba7781, NAME => 'testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp 2023-10-06 04:00:48,013 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6c91673b6a076ed72a83a99b2f56fb0b, NAME => 'testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp 2023-10-06 04:00:48,033 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:00:48,034 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 6d803f0b94bab480136c07b795ba7781, disabling compactions & flushes 2023-10-06 04:00:48,034 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781. 2023-10-06 04:00:48,034 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781. 2023-10-06 04:00:48,034 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781. after waiting 0 ms 2023-10-06 04:00:48,035 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781. 2023-10-06 04:00:48,035 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781. 2023-10-06 04:00:48,035 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 6d803f0b94bab480136c07b795ba7781: 2023-10-06 04:00:48,035 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:00:48,035 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 6c91673b6a076ed72a83a99b2f56fb0b, disabling compactions & flushes 2023-10-06 04:00:48,036 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b. 2023-10-06 04:00:48,036 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b. 2023-10-06 04:00:48,036 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b. after waiting 0 ms 2023-10-06 04:00:48,036 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b. 2023-10-06 04:00:48,036 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b. 2023-10-06 04:00:48,036 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 6c91673b6a076ed72a83a99b2f56fb0b: 2023-10-06 04:00:48,039 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-06 04:00:48,040 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696564848039"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696564848039"}]},"ts":"1696564848039"} 2023-10-06 04:00:48,040 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696564848039"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696564848039"}]},"ts":"1696564848039"} 2023-10-06 04:00:48,043 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-06 04:00:48,044 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-06 04:00:48,044 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696564848044"}]},"ts":"1696564848044"} 2023-10-06 04:00:48,045 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-10-06 04:00:48,051 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-06 04:00:48,052 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-06 04:00:48,052 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-06 04:00:48,052 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-06 04:00:48,052 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-06 04:00:48,053 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6c91673b6a076ed72a83a99b2f56fb0b, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6d803f0b94bab480136c07b795ba7781, ASSIGN}] 2023-10-06 04:00:48,055 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6c91673b6a076ed72a83a99b2f56fb0b, ASSIGN 2023-10-06 04:00:48,055 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6d803f0b94bab480136c07b795ba7781, ASSIGN 2023-10-06 04:00:48,056 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6c91673b6a076ed72a83a99b2f56fb0b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36359,1696564824167; forceNewPlan=false, retain=false 2023-10-06 04:00:48,056 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6d803f0b94bab480136c07b795ba7781, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36351,1696564824083; forceNewPlan=false, retain=false 2023-10-06 04:00:48,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-06 04:00:48,207 INFO [jenkins-hbase4:45627] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-06 04:00:48,209 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=6c91673b6a076ed72a83a99b2f56fb0b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:48,209 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=6d803f0b94bab480136c07b795ba7781, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:48,210 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696564848209"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696564848209"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696564848209"}]},"ts":"1696564848209"} 2023-10-06 04:00:48,210 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696564848209"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696564848209"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696564848209"}]},"ts":"1696564848209"} 2023-10-06 04:00:48,212 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 6c91673b6a076ed72a83a99b2f56fb0b, server=jenkins-hbase4.apache.org,36359,1696564824167}] 2023-10-06 04:00:48,213 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 6d803f0b94bab480136c07b795ba7781, server=jenkins-hbase4.apache.org,36351,1696564824083}] 2023-10-06 04:00:48,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-06 04:00:48,372 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b. 2023-10-06 04:00:48,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6c91673b6a076ed72a83a99b2f56fb0b, NAME => 'testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b.', STARTKEY => '', ENDKEY => '1'} 2023-10-06 04:00:48,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b. service=AccessControlService 2023-10-06 04:00:48,373 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 04:00:48,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 6c91673b6a076ed72a83a99b2f56fb0b 2023-10-06 04:00:48,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:00:48,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6c91673b6a076ed72a83a99b2f56fb0b 2023-10-06 04:00:48,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6c91673b6a076ed72a83a99b2f56fb0b 2023-10-06 04:00:48,374 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781. 2023-10-06 04:00:48,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6d803f0b94bab480136c07b795ba7781, NAME => 'testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781.', STARTKEY => '1', ENDKEY => ''} 2023-10-06 04:00:48,375 INFO [StoreOpener-6c91673b6a076ed72a83a99b2f56fb0b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6c91673b6a076ed72a83a99b2f56fb0b 2023-10-06 04:00:48,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781. service=AccessControlService 2023-10-06 04:00:48,375 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 04:00:48,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 6d803f0b94bab480136c07b795ba7781 2023-10-06 04:00:48,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:00:48,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6d803f0b94bab480136c07b795ba7781 2023-10-06 04:00:48,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6d803f0b94bab480136c07b795ba7781 2023-10-06 04:00:48,376 DEBUG [StoreOpener-6c91673b6a076ed72a83a99b2f56fb0b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemState/6c91673b6a076ed72a83a99b2f56fb0b/cf 2023-10-06 04:00:48,376 DEBUG [StoreOpener-6c91673b6a076ed72a83a99b2f56fb0b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemState/6c91673b6a076ed72a83a99b2f56fb0b/cf 2023-10-06 04:00:48,377 INFO [StoreOpener-6d803f0b94bab480136c07b795ba7781-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6d803f0b94bab480136c07b795ba7781 2023-10-06 04:00:48,377 INFO [StoreOpener-6c91673b6a076ed72a83a99b2f56fb0b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6c91673b6a076ed72a83a99b2f56fb0b columnFamilyName cf 2023-10-06 04:00:48,378 DEBUG [StoreOpener-6d803f0b94bab480136c07b795ba7781-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemState/6d803f0b94bab480136c07b795ba7781/cf 2023-10-06 04:00:48,378 DEBUG [StoreOpener-6d803f0b94bab480136c07b795ba7781-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemState/6d803f0b94bab480136c07b795ba7781/cf 2023-10-06 04:00:48,378 INFO [StoreOpener-6c91673b6a076ed72a83a99b2f56fb0b-1] regionserver.HStore(310): Store=6c91673b6a076ed72a83a99b2f56fb0b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 04:00:48,380 INFO [StoreOpener-6d803f0b94bab480136c07b795ba7781-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6d803f0b94bab480136c07b795ba7781 columnFamilyName cf 2023-10-06 04:00:48,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemState/6c91673b6a076ed72a83a99b2f56fb0b 2023-10-06 04:00:48,381 INFO [StoreOpener-6d803f0b94bab480136c07b795ba7781-1] regionserver.HStore(310): Store=6d803f0b94bab480136c07b795ba7781/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 04:00:48,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemState/6c91673b6a076ed72a83a99b2f56fb0b 2023-10-06 04:00:48,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemState/6d803f0b94bab480136c07b795ba7781 2023-10-06 04:00:48,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemState/6d803f0b94bab480136c07b795ba7781 2023-10-06 04:00:48,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6c91673b6a076ed72a83a99b2f56fb0b 2023-10-06 04:00:48,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6d803f0b94bab480136c07b795ba7781 2023-10-06 04:00:48,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemState/6c91673b6a076ed72a83a99b2f56fb0b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 04:00:48,388 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6c91673b6a076ed72a83a99b2f56fb0b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66501362, jitterRate=-0.009052485227584839}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 04:00:48,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6c91673b6a076ed72a83a99b2f56fb0b: 2023-10-06 04:00:48,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemState/6d803f0b94bab480136c07b795ba7781/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 04:00:48,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6d803f0b94bab480136c07b795ba7781; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70130110, jitterRate=0.045020073652267456}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 04:00:48,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6d803f0b94bab480136c07b795ba7781: 2023-10-06 04:00:48,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b., pid=30, masterSystemTime=1696564848364 2023-10-06 04:00:48,390 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781., pid=31, masterSystemTime=1696564848366 2023-10-06 04:00:48,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b. 2023-10-06 04:00:48,391 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b. 2023-10-06 04:00:48,392 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=6c91673b6a076ed72a83a99b2f56fb0b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:48,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781. 2023-10-06 04:00:48,392 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781. 2023-10-06 04:00:48,392 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696564848392"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696564848392"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696564848392"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696564848392"}]},"ts":"1696564848392"} 2023-10-06 04:00:48,393 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=6d803f0b94bab480136c07b795ba7781, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:48,393 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696564848393"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696564848393"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696564848393"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696564848393"}]},"ts":"1696564848393"} 2023-10-06 04:00:48,397 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=28 2023-10-06 04:00:48,399 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 6c91673b6a076ed72a83a99b2f56fb0b, server=jenkins-hbase4.apache.org,36359,1696564824167 in 182 msec 2023-10-06 04:00:48,400 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-10-06 04:00:48,401 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 6d803f0b94bab480136c07b795ba7781, server=jenkins-hbase4.apache.org,36351,1696564824083 in 183 msec 2023-10-06 04:00:48,402 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6c91673b6a076ed72a83a99b2f56fb0b, ASSIGN in 346 msec 2023-10-06 04:00:48,403 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-10-06 04:00:48,404 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6d803f0b94bab480136c07b795ba7781, ASSIGN in 348 msec 2023-10-06 04:00:48,404 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-06 04:00:48,405 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696564848404"}]},"ts":"1696564848404"} 2023-10-06 04:00:48,406 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-10-06 04:00:48,409 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-06 04:00:48,409 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-10-06 04:00:48,411 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36351] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-06 04:00:48,413 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:00:48,413 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:00:48,413 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:00:48,413 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:00:48,415 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-06 04:00:48,416 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-06 04:00:48,415 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-06 04:00:48,415 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-06 04:00:48,417 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 427 msec 2023-10-06 04:00:48,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-06 04:00:48,600 INFO [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-10-06 04:00:48,603 DEBUG [Listener at jenkins-hbase4.apache.org/34869] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-06 04:00:48,603 DEBUG [Listener at jenkins-hbase4.apache.org/34869] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b. 2023-10-06 04:00:48,605 INFO [Listener at jenkins-hbase4.apache.org/34869] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 04:00:48,625 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 04:00:48,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696564848625 (current time:1696564848625). 2023-10-06 04:00:48,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 04:00:48,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(139): Connect 0x0a7dc6dd to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 04:00:48,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@19b45493, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 04:00:48,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 04:00:48,644 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59974, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 04:00:48,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a7dc6dd to 127.0.0.1:57105 2023-10-06 04:00:48,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:00:48,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(139): Connect 0x50d9eec6 to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 04:00:48,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3476812e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 04:00:48,653 DEBUG [hconnection-0xfdd4bff-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 04:00:48,654 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59982, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 04:00:48,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50d9eec6 to 127.0.0.1:57105 2023-10-06 04:00:48,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:00:48,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-06 04:00:48,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 04:00:48,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 04:00:48,664 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot, current working dir path: hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 04:00:48,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-06 04:00:48,666 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-06 04:00:48,667 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696565448667 2023-10-06 04:00:48,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 04:00:48,667 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-06 04:00:48,668 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 04:00:48,669 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 04:00:48,670 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-06 04:00:48,670 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-06 04:00:48,671 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-10-06 04:00:48,672 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-06 04:00:48,673 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696565448673 2023-10-06 04:00:48,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,686 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-10-06 04:00:48,687 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:00:48,688 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-10-06 04:00:48,688 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-06 04:00:48,688 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,688 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,690 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:00:48,690 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:48,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:00:48,690 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:00:48,690 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:00:48,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:00:48,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:00:48,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:00:48,691 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:48,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:00:48,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:00:48,691 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:48,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,692 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:48,692 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 04:00:48,692 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,692 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,692 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-06 04:00:48,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-06 04:00:48,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-06 04:00:48,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,692 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-06 04:00:48,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,692 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-06 04:00:48,692 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-06 04:00:48,693 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,693 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-06 04:00:48,693 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:00:48,693 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,694 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-06 04:00:48,694 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-06 04:00:48,694 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:00:48,694 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,695 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-06 04:00:48,695 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-06 04:00:48,695 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:00:48,694 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-06 04:00:48,696 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-06 04:00:48,696 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36359,1696564824167' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-06 04:00:48,696 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-06 04:00:48,696 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36351,1696564824083' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-06 04:00:48,695 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-06 04:00:48,696 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38169,1696564824132' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-06 04:00:48,697 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,697 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:48,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:48,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:00:48,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:00:48,703 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:48,703 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,703 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,703 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:00:48,703 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:00:48,703 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,703 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:00:48,703 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,704 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:00:48,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:00:48,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:48,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:48,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:48,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:00:48,705 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36359,1696564824167' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-06 04:00:48,705 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54381c97[Count = 1] remaining members to acquire global barrier 2023-10-06 04:00:48,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:48,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:00:48,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:00:48,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:00:48,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:00:48,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:48,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:48,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:48,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:00:48,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36351,1696564824083' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-06 04:00:48,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54381c97[Count = 0] remaining members to acquire global barrier 2023-10-06 04:00:48,708 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-06 04:00:48,708 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,710 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,710 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,710 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,710 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:48,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,710 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-06 04:00:48,710 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-06 04:00:48,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,711 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-06 04:00:48,711 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:48,711 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 04:00:48,711 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-06 04:00:48,711 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38169,1696564824132' in zk 2023-10-06 04:00:48,711 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 04:00:48,711 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781. 2023-10-06 04:00:48,711 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b. 2023-10-06 04:00:48,711 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 04:00:48,711 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 04:00:48,711 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b. started... 2023-10-06 04:00:48,711 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781. started... 2023-10-06 04:00:48,711 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 04:00:48,711 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6c91673b6a076ed72a83a99b2f56fb0b: 2023-10-06 04:00:48,712 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6d803f0b94bab480136c07b795ba7781: 2023-10-06 04:00:48,713 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,713 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:48,713 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 04:00:48,713 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 04:00:48,713 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 04:00:48,713 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 04:00:48,713 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-06 04:00:48,714 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:00:48,714 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-06 04:00:48,769 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 04:00:48,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-06 04:00:48,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-06 04:00:48,770 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 04:00:48,970 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 04:00:48,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-06 04:00:48,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-06 04:00:48,972 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-06 04:00:49,139 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b. completed. 2023-10-06 04:00:49,139 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b. 2023-10-06 04:00:49,139 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 04:00:49,139 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 04:00:49,139 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:49,139 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781. completed. 2023-10-06 04:00:49,139 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781. 2023-10-06 04:00:49,139 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-06 04:00:49,139 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 04:00:49,139 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36359,1696564824167' in zk 2023-10-06 04:00:49,139 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 04:00:49,139 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:49,139 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-06 04:00:49,139 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36351,1696564824083' in zk 2023-10-06 04:00:49,141 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-06 04:00:49,141 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:49,141 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:00:49,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:49,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:00:49,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:00:49,141 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-06 04:00:49,143 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:49,143 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-06 04:00:49,143 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:00:49,143 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-06 04:00:49,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:00:49,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:00:49,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:49,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:49,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:49,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:49,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:00:49,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:49,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:49,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:49,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:49,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,36359,1696564824167': 2023-10-06 04:00:49,148 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36359,1696564824167' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-06 04:00:49,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:49,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:00:49,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:00:49,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:00:49,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:00:49,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:49,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:49,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:49,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:49,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:00:49,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:49,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:49,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:49,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:49,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,36351,1696564824083': 2023-10-06 04:00:49,152 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36351,1696564824083' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-06 04:00:49,152 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-10-06 04:00:49,152 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 04:00:49,152 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 04:00:49,152 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:49,152 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 04:00:49,155 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:49,155 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:49,155 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:49,155 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:00:49,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:49,155 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:49,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:49,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:49,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:49,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:49,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:49,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:00:49,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:00:49,155 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:00:49,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:49,155 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:00:49,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:00:49,156 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:49,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:00:49,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:00:49,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:00:49,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:00:49,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:00:49,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:00:49,156 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:49,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:49,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:49,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:49,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:49,157 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:49,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:00:49,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:49,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:49,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:49,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:49,159 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:49,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:00:49,159 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:49,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:49,160 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:49,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:49,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:49,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:49,163 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:49,163 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:49,163 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:49,163 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:49,163 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:00:49,163 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:00:49,164 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:00:49,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:00:49,164 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:00:49,163 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:49,163 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:00:49,165 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:49,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:00:49,165 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:49,165 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:00:49,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:00:49,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:00:49,164 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:49,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:00:49,164 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:00:49,166 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-06 04:00:49,165 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:49,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:00:49,166 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:49,166 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 04:00:49,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:00:49,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:00:49,166 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:49,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:00:49,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:00:49,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:00:49,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:00:49,166 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:49,167 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:49,167 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-06 04:00:49,175 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:49,176 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:49,199 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:49,200 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-06 04:00:49,200 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:49,200 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-06 04:00:49,201 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696564848668Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696564849175 (+507 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1696564849175Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1696564849176 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1696564849180 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1696564849191 (+11 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696564849200 (+9 ms) 2023-10-06 04:00:49,203 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-06 04:00:49,205 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 535 msec 2023-10-06 04:00:49,272 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 04:00:49,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-06 04:00:49,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 04:00:49,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 04:00:49,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36351] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 04:00:49,283 DEBUG [Listener at jenkins-hbase4.apache.org/34869] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-06 04:00:49,284 DEBUG [Listener at jenkins-hbase4.apache.org/34869] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b. 2023-10-06 04:00:49,284 INFO [Listener at jenkins-hbase4.apache.org/34869] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 04:00:49,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 04:00:49,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696564849295 (current time:1696564849295). 2023-10-06 04:00:49,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 04:00:49,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(139): Connect 0x4debdd57 to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 04:00:49,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45bd817, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 04:00:49,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 04:00:49,307 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59990, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 04:00:49,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4debdd57 to 127.0.0.1:57105 2023-10-06 04:00:49,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:00:49,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(139): Connect 0x48ebc48b to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 04:00:49,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b859ac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 04:00:49,316 DEBUG [hconnection-0x3efb2558-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 04:00:49,318 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60004, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 04:00:49,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48ebc48b to 127.0.0.1:57105 2023-10-06 04:00:49,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:00:49,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-06 04:00:49,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 04:00:49,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 04:00:49,329 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot, current working dir path: hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 04:00:49,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-06 04:00:49,331 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-06 04:00:49,332 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696565449332 2023-10-06 04:00:49,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 04:00:49,332 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-06 04:00:49,333 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 04:00:49,333 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 04:00:49,335 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-06 04:00:49,335 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-06 04:00:49,339 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-10-06 04:00:49,340 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-06 04:00:49,344 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696565449344 2023-10-06 04:00:49,356 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-10-06 04:00:49,356 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-10-06 04:00:49,356 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:00:49,357 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-10-06 04:00:49,357 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-06 04:00:49,358 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,358 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,359 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:00:49,359 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:00:49,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:00:49,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:00:49,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:00:49,359 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:49,359 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:00:49,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:00:49,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:00:49,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:00:49,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,360 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:49,360 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:49,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,361 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,361 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:49,361 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 04:00:49,361 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,361 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-06 04:00:49,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-06 04:00:49,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,361 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-06 04:00:49,361 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-06 04:00:49,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-06 04:00:49,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,362 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-06 04:00:49,362 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-06 04:00:49,362 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-06 04:00:49,362 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-06 04:00:49,362 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-06 04:00:49,362 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:00:49,362 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:00:49,363 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-06 04:00:49,364 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-06 04:00:49,364 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-06 04:00:49,362 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-06 04:00:49,364 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36351,1696564824083' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-06 04:00:49,364 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-06 04:00:49,364 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:00:49,364 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-06 04:00:49,365 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-06 04:00:49,365 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-06 04:00:49,365 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38169,1696564824132' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-06 04:00:49,365 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36359,1696564824167' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-06 04:00:49,366 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:49,366 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:49,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:00:49,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:00:49,368 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,368 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:00:49,368 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:49,368 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:00:49,368 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,368 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,368 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:00:49,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:00:49,369 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,369 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:00:49,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-06 04:00:49,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:49,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:49,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:49,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:00:49,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36351,1696564824083' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-06 04:00:49,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ba2f116[Count = 1] remaining members to acquire global barrier 2023-10-06 04:00:49,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:49,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:00:49,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:00:49,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:00:49,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:00:49,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-06 04:00:49,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:49,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:49,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:49,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:00:49,373 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36359,1696564824167' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-06 04:00:49,373 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ba2f116[Count = 0] remaining members to acquire global barrier 2023-10-06 04:00:49,373 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-06 04:00:49,373 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,374 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,374 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,374 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,374 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:49,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,374 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-06 04:00:49,375 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-06 04:00:49,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,375 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:49,375 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 04:00:49,375 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 04:00:49,375 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 04:00:49,375 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 04:00:49,375 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781. 2023-10-06 04:00:49,375 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 04:00:49,375 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781. started... 2023-10-06 04:00:49,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,375 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b. 2023-10-06 04:00:49,375 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-06 04:00:49,375 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-06 04:00:49,375 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38169,1696564824132' in zk 2023-10-06 04:00:49,375 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b. started... 2023-10-06 04:00:49,375 INFO [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6d803f0b94bab480136c07b795ba7781 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-10-06 04:00:49,375 INFO [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6c91673b6a076ed72a83a99b2f56fb0b 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-10-06 04:00:49,377 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-06 04:00:49,377 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:00:49,377 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-06 04:00:49,407 INFO [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231006000f04ee19784d3d9bb3e4e0985e3f4f to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231006000f04ee19784d3d9bb3e4e0985e3f4f 2023-10-06 04:00:49,412 INFO [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023100656a01c5676c7465a84a2840f23efd6cf to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023100656a01c5676c7465a84a2840f23efd6cf 2023-10-06 04:00:49,428 INFO [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemState/6c91673b6a076ed72a83a99b2f56fb0b/.tmp/cf/f536661d0a754b5ba5a6ba4006280bbb 2023-10-06 04:00:49,432 INFO [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemState/6d803f0b94bab480136c07b795ba7781/.tmp/cf/c7e13ef5a4554c6ca43423088de4c643 2023-10-06 04:00:49,435 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 04:00:49,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-06 04:00:49,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-06 04:00:49,437 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 04:00:49,440 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemState/6c91673b6a076ed72a83a99b2f56fb0b/.tmp/cf/f536661d0a754b5ba5a6ba4006280bbb as hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemState/6c91673b6a076ed72a83a99b2f56fb0b/cf/f536661d0a754b5ba5a6ba4006280bbb 2023-10-06 04:00:49,447 INFO [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemState/6c91673b6a076ed72a83a99b2f56fb0b/cf/f536661d0a754b5ba5a6ba4006280bbb, entries=6, sequenceid=6, filesize=5.9 K 2023-10-06 04:00:49,448 INFO [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 6c91673b6a076ed72a83a99b2f56fb0b in 73ms, sequenceid=6, compaction requested=false 2023-10-06 04:00:49,448 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-10-06 04:00:49,449 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6c91673b6a076ed72a83a99b2f56fb0b: 2023-10-06 04:00:49,449 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-06 04:00:49,449 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 04:00:49,449 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemState/6c91673b6a076ed72a83a99b2f56fb0b/cf/f536661d0a754b5ba5a6ba4006280bbb] hfiles 2023-10-06 04:00:49,449 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemState/6c91673b6a076ed72a83a99b2f56fb0b/cf/f536661d0a754b5ba5a6ba4006280bbb for snapshot=snaptb0-testExportFileSystemState 2023-10-06 04:00:49,449 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemState/6d803f0b94bab480136c07b795ba7781/.tmp/cf/c7e13ef5a4554c6ca43423088de4c643 as hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemState/6d803f0b94bab480136c07b795ba7781/cf/c7e13ef5a4554c6ca43423088de4c643 2023-10-06 04:00:49,457 INFO [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemState/6d803f0b94bab480136c07b795ba7781/cf/c7e13ef5a4554c6ca43423088de4c643, entries=44, sequenceid=6, filesize=12.3 K 2023-10-06 04:00:49,459 INFO [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 6d803f0b94bab480136c07b795ba7781 in 84ms, sequenceid=6, compaction requested=false 2023-10-06 04:00:49,460 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6d803f0b94bab480136c07b795ba7781: 2023-10-06 04:00:49,460 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-06 04:00:49,461 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 04:00:49,461 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemState/6d803f0b94bab480136c07b795ba7781/cf/c7e13ef5a4554c6ca43423088de4c643] hfiles 2023-10-06 04:00:49,461 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemState/6d803f0b94bab480136c07b795ba7781/cf/c7e13ef5a4554c6ca43423088de4c643 for snapshot=snaptb0-testExportFileSystemState 2023-10-06 04:00:49,480 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781. completed. 2023-10-06 04:00:49,480 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781. 2023-10-06 04:00:49,480 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 04:00:49,480 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 04:00:49,480 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:49,480 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-06 04:00:49,480 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36351,1696564824083' in zk 2023-10-06 04:00:49,486 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-06 04:00:49,486 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:49,486 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:00:49,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:49,486 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-06 04:00:49,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:00:49,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:00:49,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:00:49,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:00:49,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-06 04:00:49,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:49,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:49,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:49,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:00:49,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-06 04:00:49,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:49,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:49,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,36351,1696564824083': 2023-10-06 04:00:49,492 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36351,1696564824083' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-06 04:00:49,637 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 04:00:49,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-06 04:00:49,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-06 04:00:49,639 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-06 04:00:49,872 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b. completed. 2023-10-06 04:00:49,872 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b. 2023-10-06 04:00:49,872 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 04:00:49,872 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 04:00:49,872 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:49,872 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-06 04:00:49,872 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36359,1696564824167' in zk 2023-10-06 04:00:49,874 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:49,874 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-06 04:00:49,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:49,874 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:00:49,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:00:49,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:00:49,874 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-06 04:00:49,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:00:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:00:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-06 04:00:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:49,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:49,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:49,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:00:49,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-06 04:00:49,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:49,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:49,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:49,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,36359,1696564824167': 2023-10-06 04:00:49,880 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36359,1696564824167' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-06 04:00:49,880 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-10-06 04:00:49,880 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 04:00:49,880 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 04:00:49,880 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-10-06 04:00:49,880 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 04:00:49,882 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,882 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:00:49,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:00:49,882 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,882 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,882 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:00:49,882 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:00:49,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:00:49,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,882 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:00:49,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,883 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:49,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-06 04:00:49,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:00:49,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:00:49,883 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:49,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:00:49,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:00:49,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:00:49,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:00:49,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:00:49,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,883 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:49,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-06 04:00:49,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:49,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:49,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:49,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:00:49,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-06 04:00:49,885 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:49,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:49,886 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:49,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:49,886 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:49,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:49,890 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:49,890 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,890 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:00:49,890 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:00:49,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:00:49,891 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:00:49,891 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:00:49,891 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:00:49,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:00:49,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:00:49,890 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:49,891 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-10-06 04:00:49,891 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:00:49,891 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:00:49,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:00:49,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:00:49,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:00:49,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:00:49,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:00:49,891 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-06 04:00:49,891 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:49,893 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-06 04:00:49,893 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,893 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 04:00:49,893 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:00:49,893 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:00:49,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:00:49,893 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:00:49,893 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:00:49,893 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,893 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,894 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023100656a01c5676c7465a84a2840f23efd6cf, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231006000f04ee19784d3d9bb3e4e0985e3f4f] mob files 2023-10-06 04:00:49,894 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023100656a01c5676c7465a84a2840f23efd6cf 2023-10-06 04:00:49,894 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231006000f04ee19784d3d9bb3e4e0985e3f4f 2023-10-06 04:00:49,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:00:49,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:00:49,903 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-10-06 04:00:49,904 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,925 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,926 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-06 04:00:49,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,926 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696564849332Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696564849903 (+571 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1696564849903Loading Region manifests for snaptb0-testExportFileSystemState at 1696564849903Writing data manifest for snaptb0-testExportFileSystemState at 1696564849907 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1696564849917 (+10 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696564849926 (+9 ms) 2023-10-06 04:00:49,930 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-06 04:00:49,932 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 597 msec 2023-10-06 04:00:49,939 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 04:00:49,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-06 04:00:49,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 04:00:49,941 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564849941 2023-10-06 04:00:49,941 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42421, tgtDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564849941, rawTgtDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564849941, srcFsUri=hdfs://localhost:42421, srcDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91 2023-10-06 04:00:49,972 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42421, inputRoot=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91 2023-10-06 04:00:49,972 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_242925779_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564849941, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564849941/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-06 04:00:49,972 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42421, inputRoot=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91, snapshotDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-10-06 04:00:49,983 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564849941/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-06 04:00:50,013 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-06 04:00:50,014 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-06 04:00:50,014 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-06 04:00:50,015 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-06 04:00:50,015 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-06 04:00:50,016 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-06 04:00:50,016 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-06 04:00:50,094 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/hadoop-2925366520032011452.jar 2023-10-06 04:00:50,094 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-06 04:00:50,095 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-06 04:00:50,095 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-06 04:00:50,095 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-06 04:00:50,096 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-06 04:00:50,096 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-06 04:00:50,096 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-06 04:00:50,097 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-06 04:00:50,097 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-06 04:00:50,097 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-06 04:00:50,098 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-06 04:00:50,098 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-06 04:00:50,099 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-06 04:00:50,099 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-06 04:00:50,099 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-06 04:00:50,100 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-06 04:00:50,100 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 04:00:50,100 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 04:00:50,101 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 04:00:50,101 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 04:00:50,101 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 04:00:50,102 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 04:00:50,102 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 04:00:50,566 WARN [Listener at jenkins-hbase4.apache.org/34869] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-06 04:00:50,568 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-10-06 04:00:50,571 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-06 04:00:51,637 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 04:00:51,637 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 04:00:51,644 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696564830351_0001_000001 (auth:SIMPLE) 2023-10-06 04:00:52,310 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696564830351_0002_000001 (auth:SIMPLE) 2023-10-06 04:00:53,254 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-06 04:00:56,291 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696564830351_0002_000001 (auth:SIMPLE) 2023-10-06 04:00:58,528 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696564830351_0002_000001 (auth:SIMPLE) 2023-10-06 04:01:01,792 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696564830351_0002_000001 (auth:SIMPLE) 2023-10-06 04:01:03,774 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-06 04:01:03,775 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-06 04:01:03,784 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-10-06 04:01:03,784 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-06 04:01:03,785 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-06 04:01:03,785 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1023520784_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-06 04:01:03,786 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(367): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-06 04:01:03,786 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(367): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-06 04:01:03,786 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1023520784_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564849941/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564849941/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-06 04:01:03,786 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(367): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564849941/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-06 04:01:03,786 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(367): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564849941/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-06 04:01:03,793 INFO [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-10-06 04:01:03,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-10-06 04:01:03,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-10-06 04:01:03,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-06 04:01:03,799 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696564863799"}]},"ts":"1696564863799"} 2023-10-06 04:01:03,801 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-10-06 04:01:03,803 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-10-06 04:01:03,804 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6c91673b6a076ed72a83a99b2f56fb0b, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6d803f0b94bab480136c07b795ba7781, UNASSIGN}] 2023-10-06 04:01:03,806 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6c91673b6a076ed72a83a99b2f56fb0b, UNASSIGN 2023-10-06 04:01:03,806 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6d803f0b94bab480136c07b795ba7781, UNASSIGN 2023-10-06 04:01:03,807 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=6c91673b6a076ed72a83a99b2f56fb0b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:03,807 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=6d803f0b94bab480136c07b795ba7781, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:03,807 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696564863807"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696564863807"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696564863807"}]},"ts":"1696564863807"} 2023-10-06 04:01:03,807 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696564863807"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696564863807"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696564863807"}]},"ts":"1696564863807"} 2023-10-06 04:01:03,809 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 6c91673b6a076ed72a83a99b2f56fb0b, server=jenkins-hbase4.apache.org,36359,1696564824167}] 2023-10-06 04:01:03,810 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 6d803f0b94bab480136c07b795ba7781, server=jenkins-hbase4.apache.org,36351,1696564824083}] 2023-10-06 04:01:03,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-06 04:01:03,962 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6c91673b6a076ed72a83a99b2f56fb0b 2023-10-06 04:01:03,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6c91673b6a076ed72a83a99b2f56fb0b, disabling compactions & flushes 2023-10-06 04:01:03,962 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b. 2023-10-06 04:01:03,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b. 2023-10-06 04:01:03,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b. after waiting 0 ms 2023-10-06 04:01:03,962 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6d803f0b94bab480136c07b795ba7781 2023-10-06 04:01:03,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b. 2023-10-06 04:01:03,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6d803f0b94bab480136c07b795ba7781, disabling compactions & flushes 2023-10-06 04:01:03,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781. 2023-10-06 04:01:03,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781. 2023-10-06 04:01:03,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781. after waiting 0 ms 2023-10-06 04:01:03,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781. 2023-10-06 04:01:03,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemState/6c91673b6a076ed72a83a99b2f56fb0b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 04:01:03,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemState/6d803f0b94bab480136c07b795ba7781/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 04:01:03,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 04:01:03,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 04:01:03,973 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b. 2023-10-06 04:01:03,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781. 2023-10-06 04:01:03,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6c91673b6a076ed72a83a99b2f56fb0b: 2023-10-06 04:01:03,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6d803f0b94bab480136c07b795ba7781: 2023-10-06 04:01:03,976 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6d803f0b94bab480136c07b795ba7781 2023-10-06 04:01:03,977 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=6d803f0b94bab480136c07b795ba7781, regionState=CLOSED 2023-10-06 04:01:03,977 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6c91673b6a076ed72a83a99b2f56fb0b 2023-10-06 04:01:03,977 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696564863977"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696564863977"}]},"ts":"1696564863977"} 2023-10-06 04:01:03,977 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=6c91673b6a076ed72a83a99b2f56fb0b, regionState=CLOSED 2023-10-06 04:01:03,978 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696564863977"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696564863977"}]},"ts":"1696564863977"} 2023-10-06 04:01:03,981 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-10-06 04:01:03,981 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 6d803f0b94bab480136c07b795ba7781, server=jenkins-hbase4.apache.org,36351,1696564824083 in 168 msec 2023-10-06 04:01:03,982 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-10-06 04:01:03,982 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 6c91673b6a076ed72a83a99b2f56fb0b, server=jenkins-hbase4.apache.org,36359,1696564824167 in 170 msec 2023-10-06 04:01:03,983 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6d803f0b94bab480136c07b795ba7781, UNASSIGN in 177 msec 2023-10-06 04:01:03,984 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-10-06 04:01:03,984 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6c91673b6a076ed72a83a99b2f56fb0b, UNASSIGN in 178 msec 2023-10-06 04:01:03,985 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696564863985"}]},"ts":"1696564863985"} 2023-10-06 04:01:03,986 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-10-06 04:01:03,988 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-10-06 04:01:03,990 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 195 msec 2023-10-06 04:01:04,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-06 04:01:04,101 INFO [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-10-06 04:01:04,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-10-06 04:01:04,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-06 04:01:04,106 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-06 04:01:04,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-10-06 04:01:04,107 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-06 04:01:04,108 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36351] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-10-06 04:01:04,112 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-06 04:01:04,112 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-06 04:01:04,112 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-06 04:01:04,112 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-06 04:01:04,113 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemState/6c91673b6a076ed72a83a99b2f56fb0b 2023-10-06 04:01:04,113 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-06 04:01:04,113 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-06 04:01:04,113 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-06 04:01:04,113 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemState/6d803f0b94bab480136c07b795ba7781 2023-10-06 04:01:04,113 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-06 04:01:04,114 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-06 04:01:04,114 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-06 04:01:04,115 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-06 04:01:04,115 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-06 04:01:04,115 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:01:04,114 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:01:04,115 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:01:04,115 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:01:04,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-06 04:01:04,116 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemState/6c91673b6a076ed72a83a99b2f56fb0b/cf, FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemState/6c91673b6a076ed72a83a99b2f56fb0b/recovered.edits] 2023-10-06 04:01:04,117 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemState/6d803f0b94bab480136c07b795ba7781/cf, FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemState/6d803f0b94bab480136c07b795ba7781/recovered.edits] 2023-10-06 04:01:04,121 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemState/6c91673b6a076ed72a83a99b2f56fb0b/cf/f536661d0a754b5ba5a6ba4006280bbb to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testExportFileSystemState/6c91673b6a076ed72a83a99b2f56fb0b/cf/f536661d0a754b5ba5a6ba4006280bbb 2023-10-06 04:01:04,121 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemState/6d803f0b94bab480136c07b795ba7781/cf/c7e13ef5a4554c6ca43423088de4c643 to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testExportFileSystemState/6d803f0b94bab480136c07b795ba7781/cf/c7e13ef5a4554c6ca43423088de4c643 2023-10-06 04:01:04,125 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemState/6c91673b6a076ed72a83a99b2f56fb0b/recovered.edits/9.seqid to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testExportFileSystemState/6c91673b6a076ed72a83a99b2f56fb0b/recovered.edits/9.seqid 2023-10-06 04:01:04,125 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemState/6d803f0b94bab480136c07b795ba7781/recovered.edits/9.seqid to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testExportFileSystemState/6d803f0b94bab480136c07b795ba7781/recovered.edits/9.seqid 2023-10-06 04:01:04,126 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemState/6c91673b6a076ed72a83a99b2f56fb0b 2023-10-06 04:01:04,126 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemState/6d803f0b94bab480136c07b795ba7781 2023-10-06 04:01:04,126 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-06 04:01:04,126 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-06 04:01:04,127 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-10-06 04:01:04,132 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023100656a01c5676c7465a84a2840f23efd6cf to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023100656a01c5676c7465a84a2840f23efd6cf 2023-10-06 04:01:04,133 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231006000f04ee19784d3d9bb3e4e0985e3f4f to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231006000f04ee19784d3d9bb3e4e0985e3f4f 2023-10-06 04:01:04,134 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-06 04:01:04,137 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-06 04:01:04,139 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-10-06 04:01:04,142 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-10-06 04:01:04,143 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-06 04:01:04,143 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-10-06 04:01:04,143 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696564864143"}]},"ts":"9223372036854775807"} 2023-10-06 04:01:04,144 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696564864143"}]},"ts":"9223372036854775807"} 2023-10-06 04:01:04,146 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-06 04:01:04,146 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6c91673b6a076ed72a83a99b2f56fb0b, NAME => 'testtb-testExportFileSystemState,,1696564847986.6c91673b6a076ed72a83a99b2f56fb0b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6d803f0b94bab480136c07b795ba7781, NAME => 'testtb-testExportFileSystemState,1,1696564847986.6d803f0b94bab480136c07b795ba7781.', STARTKEY => '1', ENDKEY => ''}] 2023-10-06 04:01:04,146 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-10-06 04:01:04,146 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696564864146"}]},"ts":"9223372036854775807"} 2023-10-06 04:01:04,148 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-10-06 04:01:04,150 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-06 04:01:04,152 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 48 msec 2023-10-06 04:01:04,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-06 04:01:04,218 INFO [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-10-06 04:01:04,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-10-06 04:01:04,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-10-06 04:01:04,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-10-06 04:01:04,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemState 2023-10-06 04:01:04,265 INFO [Listener at jenkins-hbase4.apache.org/34869] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=761 (was 753) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1023520784_17 at /127.0.0.1:33738 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x76348612-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x76348612-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (32912118) connection to jenkins-hbase4.apache.org/172.31.14.131:45483 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_366410299_17 at /127.0.0.1:57984 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x76348612-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1707933815_1 at /127.0.0.1:41596 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x76348612-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1962 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1023520784_17 at /127.0.0.1:41628 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=935 (was 930) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=310 (was 312), ProcessCount=168 (was 168), AvailableMemoryMB=5972 (was 6110) 2023-10-06 04:01:04,265 WARN [Listener at jenkins-hbase4.apache.org/34869] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-10-06 04:01:04,287 INFO [Listener at jenkins-hbase4.apache.org/34869] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=761, OpenFileDescriptor=935, MaxFileDescriptor=60000, SystemLoadAverage=310, ProcessCount=168, AvailableMemoryMB=5971 2023-10-06 04:01:04,287 WARN [Listener at jenkins-hbase4.apache.org/34869] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-10-06 04:01:04,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-06 04:01:04,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-10-06 04:01:04,293 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-10-06 04:01:04,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-10-06 04:01:04,294 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-06 04:01:04,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-06 04:01:04,297 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testConsecutiveExports/c5bf086f4d78d5798a092ee1346a2553 2023-10-06 04:01:04,297 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testConsecutiveExports/001626deeb8557f9f4ff6e6ee887a80e 2023-10-06 04:01:04,297 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testConsecutiveExports/c5bf086f4d78d5798a092ee1346a2553 empty. 2023-10-06 04:01:04,297 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testConsecutiveExports/001626deeb8557f9f4ff6e6ee887a80e empty. 2023-10-06 04:01:04,298 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testConsecutiveExports/c5bf086f4d78d5798a092ee1346a2553 2023-10-06 04:01:04,298 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testConsecutiveExports/001626deeb8557f9f4ff6e6ee887a80e 2023-10-06 04:01:04,298 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-06 04:01:04,311 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-10-06 04:01:04,312 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => c5bf086f4d78d5798a092ee1346a2553, NAME => 'testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp 2023-10-06 04:01:04,313 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 001626deeb8557f9f4ff6e6ee887a80e, NAME => 'testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp 2023-10-06 04:01:04,327 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:01:04,327 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing c5bf086f4d78d5798a092ee1346a2553, disabling compactions & flushes 2023-10-06 04:01:04,327 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553. 2023-10-06 04:01:04,327 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553. 2023-10-06 04:01:04,327 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553. after waiting 0 ms 2023-10-06 04:01:04,327 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553. 2023-10-06 04:01:04,327 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:01:04,327 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553. 2023-10-06 04:01:04,328 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 001626deeb8557f9f4ff6e6ee887a80e, disabling compactions & flushes 2023-10-06 04:01:04,328 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for c5bf086f4d78d5798a092ee1346a2553: 2023-10-06 04:01:04,328 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e. 2023-10-06 04:01:04,328 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e. 2023-10-06 04:01:04,328 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e. after waiting 0 ms 2023-10-06 04:01:04,328 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e. 2023-10-06 04:01:04,328 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e. 2023-10-06 04:01:04,328 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 001626deeb8557f9f4ff6e6ee887a80e: 2023-10-06 04:01:04,331 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-10-06 04:01:04,332 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696564864332"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696564864332"}]},"ts":"1696564864332"} 2023-10-06 04:01:04,332 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696564864332"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696564864332"}]},"ts":"1696564864332"} 2023-10-06 04:01:04,336 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-06 04:01:04,337 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-06 04:01:04,337 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696564864337"}]},"ts":"1696564864337"} 2023-10-06 04:01:04,338 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-10-06 04:01:04,343 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-06 04:01:04,345 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-06 04:01:04,345 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-06 04:01:04,345 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-06 04:01:04,345 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-06 04:01:04,345 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c5bf086f4d78d5798a092ee1346a2553, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=001626deeb8557f9f4ff6e6ee887a80e, ASSIGN}] 2023-10-06 04:01:04,348 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=001626deeb8557f9f4ff6e6ee887a80e, ASSIGN 2023-10-06 04:01:04,348 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c5bf086f4d78d5798a092ee1346a2553, ASSIGN 2023-10-06 04:01:04,349 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=001626deeb8557f9f4ff6e6ee887a80e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38169,1696564824132; forceNewPlan=false, retain=false 2023-10-06 04:01:04,349 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c5bf086f4d78d5798a092ee1346a2553, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36359,1696564824167; forceNewPlan=false, retain=false 2023-10-06 04:01:04,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-06 04:01:04,499 INFO [jenkins-hbase4:45627] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-06 04:01:04,502 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=001626deeb8557f9f4ff6e6ee887a80e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:04,502 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=c5bf086f4d78d5798a092ee1346a2553, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:04,502 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696564864502"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696564864502"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696564864502"}]},"ts":"1696564864502"} 2023-10-06 04:01:04,502 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696564864502"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696564864502"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696564864502"}]},"ts":"1696564864502"} 2023-10-06 04:01:04,504 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 001626deeb8557f9f4ff6e6ee887a80e, server=jenkins-hbase4.apache.org,38169,1696564824132}] 2023-10-06 04:01:04,505 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure c5bf086f4d78d5798a092ee1346a2553, server=jenkins-hbase4.apache.org,36359,1696564824167}] 2023-10-06 04:01:04,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-06 04:01:04,660 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e. 2023-10-06 04:01:04,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 001626deeb8557f9f4ff6e6ee887a80e, NAME => 'testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e.', STARTKEY => '1', ENDKEY => ''} 2023-10-06 04:01:04,660 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553. 2023-10-06 04:01:04,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e. service=AccessControlService 2023-10-06 04:01:04,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c5bf086f4d78d5798a092ee1346a2553, NAME => 'testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553.', STARTKEY => '', ENDKEY => '1'} 2023-10-06 04:01:04,661 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 04:01:04,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553. service=AccessControlService 2023-10-06 04:01:04,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 001626deeb8557f9f4ff6e6ee887a80e 2023-10-06 04:01:04,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:01:04,661 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 04:01:04,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 001626deeb8557f9f4ff6e6ee887a80e 2023-10-06 04:01:04,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 001626deeb8557f9f4ff6e6ee887a80e 2023-10-06 04:01:04,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports c5bf086f4d78d5798a092ee1346a2553 2023-10-06 04:01:04,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:01:04,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c5bf086f4d78d5798a092ee1346a2553 2023-10-06 04:01:04,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c5bf086f4d78d5798a092ee1346a2553 2023-10-06 04:01:04,662 INFO [StoreOpener-001626deeb8557f9f4ff6e6ee887a80e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 001626deeb8557f9f4ff6e6ee887a80e 2023-10-06 04:01:04,662 INFO [StoreOpener-c5bf086f4d78d5798a092ee1346a2553-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c5bf086f4d78d5798a092ee1346a2553 2023-10-06 04:01:04,664 DEBUG [StoreOpener-001626deeb8557f9f4ff6e6ee887a80e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testConsecutiveExports/001626deeb8557f9f4ff6e6ee887a80e/cf 2023-10-06 04:01:04,664 DEBUG [StoreOpener-c5bf086f4d78d5798a092ee1346a2553-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testConsecutiveExports/c5bf086f4d78d5798a092ee1346a2553/cf 2023-10-06 04:01:04,664 DEBUG [StoreOpener-001626deeb8557f9f4ff6e6ee887a80e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testConsecutiveExports/001626deeb8557f9f4ff6e6ee887a80e/cf 2023-10-06 04:01:04,664 DEBUG [StoreOpener-c5bf086f4d78d5798a092ee1346a2553-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testConsecutiveExports/c5bf086f4d78d5798a092ee1346a2553/cf 2023-10-06 04:01:04,664 INFO [StoreOpener-001626deeb8557f9f4ff6e6ee887a80e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 001626deeb8557f9f4ff6e6ee887a80e columnFamilyName cf 2023-10-06 04:01:04,664 INFO [StoreOpener-c5bf086f4d78d5798a092ee1346a2553-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c5bf086f4d78d5798a092ee1346a2553 columnFamilyName cf 2023-10-06 04:01:04,666 INFO [StoreOpener-c5bf086f4d78d5798a092ee1346a2553-1] regionserver.HStore(310): Store=c5bf086f4d78d5798a092ee1346a2553/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 04:01:04,666 INFO [StoreOpener-001626deeb8557f9f4ff6e6ee887a80e-1] regionserver.HStore(310): Store=001626deeb8557f9f4ff6e6ee887a80e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 04:01:04,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testConsecutiveExports/c5bf086f4d78d5798a092ee1346a2553 2023-10-06 04:01:04,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testConsecutiveExports/001626deeb8557f9f4ff6e6ee887a80e 2023-10-06 04:01:04,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testConsecutiveExports/c5bf086f4d78d5798a092ee1346a2553 2023-10-06 04:01:04,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testConsecutiveExports/001626deeb8557f9f4ff6e6ee887a80e 2023-10-06 04:01:04,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c5bf086f4d78d5798a092ee1346a2553 2023-10-06 04:01:04,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 001626deeb8557f9f4ff6e6ee887a80e 2023-10-06 04:01:04,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testConsecutiveExports/c5bf086f4d78d5798a092ee1346a2553/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 04:01:04,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testConsecutiveExports/001626deeb8557f9f4ff6e6ee887a80e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 04:01:04,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c5bf086f4d78d5798a092ee1346a2553; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60972686, jitterRate=-0.09143617749214172}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 04:01:04,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c5bf086f4d78d5798a092ee1346a2553: 2023-10-06 04:01:04,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 001626deeb8557f9f4ff6e6ee887a80e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70799231, jitterRate=0.054990753531455994}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 04:01:04,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 001626deeb8557f9f4ff6e6ee887a80e: 2023-10-06 04:01:04,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e., pid=45, masterSystemTime=1696564864656 2023-10-06 04:01:04,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553., pid=46, masterSystemTime=1696564864657 2023-10-06 04:01:04,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e. 2023-10-06 04:01:04,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e. 2023-10-06 04:01:04,677 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=001626deeb8557f9f4ff6e6ee887a80e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:04,677 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696564864677"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696564864677"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696564864677"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696564864677"}]},"ts":"1696564864677"} 2023-10-06 04:01:04,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553. 2023-10-06 04:01:04,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553. 2023-10-06 04:01:04,678 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=c5bf086f4d78d5798a092ee1346a2553, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:04,678 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696564864678"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696564864678"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696564864678"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696564864678"}]},"ts":"1696564864678"} 2023-10-06 04:01:04,682 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-10-06 04:01:04,683 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 001626deeb8557f9f4ff6e6ee887a80e, server=jenkins-hbase4.apache.org,38169,1696564824132 in 175 msec 2023-10-06 04:01:04,687 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=43 2023-10-06 04:01:04,687 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure c5bf086f4d78d5798a092ee1346a2553, server=jenkins-hbase4.apache.org,36359,1696564824167 in 176 msec 2023-10-06 04:01:04,688 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=001626deeb8557f9f4ff6e6ee887a80e, ASSIGN in 338 msec 2023-10-06 04:01:04,690 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=43, resume processing ppid=42 2023-10-06 04:01:04,690 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c5bf086f4d78d5798a092ee1346a2553, ASSIGN in 342 msec 2023-10-06 04:01:04,691 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-06 04:01:04,691 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696564864691"}]},"ts":"1696564864691"} 2023-10-06 04:01:04,692 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-10-06 04:01:04,696 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-10-06 04:01:04,696 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-10-06 04:01:04,698 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36351] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-06 04:01:04,700 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:01:04,700 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:01:04,700 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:01:04,700 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:01:04,702 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-06 04:01:04,702 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-06 04:01:04,702 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-06 04:01:04,703 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-06 04:01:04,704 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 413 msec 2023-10-06 04:01:04,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-06 04:01:04,899 INFO [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-10-06 04:01:04,901 DEBUG [Listener at jenkins-hbase4.apache.org/34869] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-06 04:01:04,901 DEBUG [Listener at jenkins-hbase4.apache.org/34869] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553. 2023-10-06 04:01:04,903 INFO [Listener at jenkins-hbase4.apache.org/34869] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 04:01:04,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-06 04:01:04,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696564864915 (current time:1696564864915). 2023-10-06 04:01:04,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 04:01:04,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(139): Connect 0x478bd70c to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 04:01:04,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d65b1ac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 04:01:04,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 04:01:04,926 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56368, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 04:01:04,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x478bd70c to 127.0.0.1:57105 2023-10-06 04:01:04,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:01:04,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(139): Connect 0x100a1bda to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 04:01:04,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9208d60, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 04:01:04,940 DEBUG [hconnection-0x69a8a539-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 04:01:04,943 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56378, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 04:01:04,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x100a1bda to 127.0.0.1:57105 2023-10-06 04:01:04,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:01:04,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-06 04:01:04,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 04:01:04,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-06 04:01:04,951 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot, current working dir path: hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 04:01:04,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-06 04:01:04,954 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-06 04:01:04,955 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696565464955 2023-10-06 04:01:04,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-06 04:01:04,955 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-06 04:01:04,956 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 04:01:04,956 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 04:01:04,959 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-06 04:01:04,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-06 04:01:04,960 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-10-06 04:01:04,961 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-06 04:01:04,962 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696565464962 2023-10-06 04:01:04,974 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,975 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-10-06 04:01:04,975 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:01:04,976 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-10-06 04:01:04,976 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-06 04:01:04,977 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,977 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,978 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:04,978 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:04,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:04,978 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:04,978 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:04,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:04,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:04,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:04,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:04,979 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:04,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:04,979 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:04,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,979 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:04,980 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 04:01:04,980 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,980 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,980 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-06 04:01:04,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-06 04:01:04,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-06 04:01:04,980 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-06 04:01:04,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,980 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-06 04:01:04,981 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-06 04:01:04,981 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,981 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,981 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-06 04:01:04,981 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,981 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:01:04,981 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-06 04:01:04,981 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-06 04:01:04,982 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:01:04,982 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-06 04:01:04,983 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-06 04:01:04,983 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-06 04:01:04,983 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-06 04:01:04,983 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38169,1696564824132' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-06 04:01:04,982 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:01:04,983 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36359,1696564824167' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-06 04:01:04,986 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-06 04:01:04,986 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-06 04:01:04,986 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36351,1696564824083' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-06 04:01:04,988 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,988 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,988 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:04,988 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:04,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:04,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:01:04,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:01:04,989 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,989 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:01:04,989 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:01:04,989 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,989 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:01:04,989 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:01:04,989 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:01:04,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:04,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:04,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:04,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:01:04,991 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38169,1696564824132' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-06 04:01:04,991 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e33f358[Count = 1] remaining members to acquire global barrier 2023-10-06 04:01:04,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:04,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:01:04,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:01:04,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:01:04,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:01:04,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:04,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:04,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:04,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:01:04,994 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36359,1696564824167' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-06 04:01:04,994 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e33f358[Count = 0] remaining members to acquire global barrier 2023-10-06 04:01:04,994 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-06 04:01:04,994 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,995 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,995 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,995 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,995 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-06 04:01:04,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,995 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:04,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,995 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-06 04:01:04,996 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-06 04:01:04,995 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-06 04:01:04,996 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36351,1696564824083' in zk 2023-10-06 04:01:04,996 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 04:01:04,996 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 04:01:04,996 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 04:01:04,996 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 04:01:04,996 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553. 2023-10-06 04:01:04,996 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:04,996 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553. started... 2023-10-06 04:01:04,996 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e. 2023-10-06 04:01:04,996 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 04:01:04,996 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e. started... 2023-10-06 04:01:04,996 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c5bf086f4d78d5798a092ee1346a2553: 2023-10-06 04:01:04,997 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 001626deeb8557f9f4ff6e6ee887a80e: 2023-10-06 04:01:04,998 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,998 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:04,998 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 04:01:04,998 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 04:01:04,998 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 04:01:04,998 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 04:01:05,005 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-06 04:01:05,005 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:01:05,005 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-06 04:01:05,021 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553. completed. 2023-10-06 04:01:05,021 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553. 2023-10-06 04:01:05,021 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 04:01:05,021 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 04:01:05,021 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:05,021 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-06 04:01:05,021 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36359,1696564824167' in zk 2023-10-06 04:01:05,024 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:05,024 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-06 04:01:05,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:05,024 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:01:05,024 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-06 04:01:05,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:01:05,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:01:05,026 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e. completed. 2023-10-06 04:01:05,026 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e. 2023-10-06 04:01:05,026 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 04:01:05,026 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 04:01:05,026 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:05,026 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-06 04:01:05,026 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38169,1696564824132' in zk 2023-10-06 04:01:05,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:01:05,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:01:05,028 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:05,028 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-06 04:01:05,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:05,028 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:01:05,028 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-06 04:01:05,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:05,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:05,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:05,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:01:05,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:05,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:05,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:05,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:05,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,36359,1696564824167': 2023-10-06 04:01:05,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36359,1696564824167' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-06 04:01:05,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:05,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:01:05,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:01:05,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:01:05,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:01:05,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:05,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:05,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:05,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:05,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:01:05,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:05,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:05,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:05,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:05,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,38169,1696564824132': 2023-10-06 04:01:05,038 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38169,1696564824132' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-06 04:01:05,038 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-10-06 04:01:05,038 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 04:01:05,038 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 04:01:05,038 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:05,038 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 04:01:05,040 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:05,040 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:05,040 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:05,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:05,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:05,040 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:05,040 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:05,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:05,040 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:05,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:05,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:05,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:01:05,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:01:05,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:05,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:05,040 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:05,041 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:05,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:01:05,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:05,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:05,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:05,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:05,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:05,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:05,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:05,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:05,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:05,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:05,042 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:05,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:01:05,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:05,043 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:05,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:05,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:05,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:05,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:01:05,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:05,045 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:05,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:05,045 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:05,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:05,045 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:05,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:05,050 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:05,050 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:05,050 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:05,050 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:05,050 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:05,050 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:05,050 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:05,050 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:05,050 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:05,050 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:05,050 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:05,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:05,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:05,050 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:05,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:05,050 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:01:05,050 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:05,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:05,050 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:05,052 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:05,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:05,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:05,050 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:05,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:05,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:05,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:05,053 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:05,052 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:05,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:05,053 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-06 04:01:05,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:05,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:05,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:05,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 04:01:05,054 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-06 04:01:05,056 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 04:01:05,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-06 04:01:05,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-06 04:01:05,057 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 04:01:05,068 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:05,069 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:05,101 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:05,102 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-06 04:01:05,102 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:05,102 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:05,102 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696564864955Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696564865068 (+113 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1696564865068Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1696564865068Writing data manifest for emptySnaptb0-testConsecutiveExports at 1696564865072 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1696564865094 (+22 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696564865102 (+8 ms) 2023-10-06 04:01:05,105 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-06 04:01:05,106 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 149 msec 2023-10-06 04:01:05,258 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 04:01:05,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-06 04:01:05,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 04:01:05,262 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 04:01:05,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38169] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 04:01:05,266 DEBUG [Listener at jenkins-hbase4.apache.org/34869] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-06 04:01:05,267 DEBUG [Listener at jenkins-hbase4.apache.org/34869] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553. 2023-10-06 04:01:05,267 INFO [Listener at jenkins-hbase4.apache.org/34869] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 04:01:05,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-06 04:01:05,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696564865277 (current time:1696564865277). 2023-10-06 04:01:05,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 04:01:05,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(139): Connect 0x0b4f6734 to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 04:01:05,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d08f705, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 04:01:05,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 04:01:05,295 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42824, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 04:01:05,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b4f6734 to 127.0.0.1:57105 2023-10-06 04:01:05,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:01:05,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(139): Connect 0x1725132d to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 04:01:05,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67a3b03a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 04:01:05,313 DEBUG [hconnection-0x2dd9d314-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 04:01:05,314 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42832, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 04:01:05,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1725132d to 127.0.0.1:57105 2023-10-06 04:01:05,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:01:05,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-06 04:01:05,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 04:01:05,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-06 04:01:05,324 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot, current working dir path: hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 04:01:05,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-06 04:01:05,327 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-06 04:01:05,328 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696565465328 2023-10-06 04:01:05,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-06 04:01:05,328 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-06 04:01:05,329 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 04:01:05,330 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 04:01:05,330 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-06 04:01:05,331 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-06 04:01:05,332 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-10-06 04:01:05,333 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-06 04:01:05,333 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696565465333 2023-10-06 04:01:05,347 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-10-06 04:01:05,347 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-10-06 04:01:05,347 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:01:05,348 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-10-06 04:01:05,349 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-06 04:01:05,349 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,349 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,350 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:05,351 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:05,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:05,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:05,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:05,351 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:05,350 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:05,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:05,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:05,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:05,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,351 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:05,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,351 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:05,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,352 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:05,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,352 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 04:01:05,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-06 04:01:05,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-06 04:01:05,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,352 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-06 04:01:05,352 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-06 04:01:05,353 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-06 04:01:05,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-06 04:01:05,353 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-06 04:01:05,353 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-06 04:01:05,353 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-06 04:01:05,353 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:01:05,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,354 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-06 04:01:05,354 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-06 04:01:05,353 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:01:05,354 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36359,1696564824167' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-06 04:01:05,354 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-06 04:01:05,356 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-06 04:01:05,356 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-06 04:01:05,356 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36351,1696564824083' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-06 04:01:05,356 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-06 04:01:05,356 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-06 04:01:05,356 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:01:05,357 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-06 04:01:05,357 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-06 04:01:05,357 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38169,1696564824132' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-06 04:01:05,358 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,358 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:05,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:05,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:01:05,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:01:05,359 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,359 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,359 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:01:05,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:01:05,361 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,361 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:01:05,361 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:01:05,361 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:05,362 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-06 04:01:05,362 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:01:05,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:05,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:05,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:05,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:01:05,363 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36359,1696564824167' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-06 04:01:05,363 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f9d9448[Count = 1] remaining members to acquire global barrier 2023-10-06 04:01:05,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:05,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:01:05,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:01:05,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:01:05,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:01:05,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-06 04:01:05,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:05,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:05,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:05,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:01:05,365 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38169,1696564824132' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-06 04:01:05,365 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f9d9448[Count = 0] remaining members to acquire global barrier 2023-10-06 04:01:05,365 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-06 04:01:05,365 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,367 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,367 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,367 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,367 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:05,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,367 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-06 04:01:05,367 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-06 04:01:05,367 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:05,367 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 04:01:05,367 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-06 04:01:05,367 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-06 04:01:05,367 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36351,1696564824083' in zk 2023-10-06 04:01:05,367 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 04:01:05,367 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 04:01:05,367 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e. 2023-10-06 04:01:05,368 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e. started... 2023-10-06 04:01:05,368 INFO [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 001626deeb8557f9f4ff6e6ee887a80e 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-10-06 04:01:05,369 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 04:01:05,369 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 04:01:05,369 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553. 2023-10-06 04:01:05,369 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553. started... 2023-10-06 04:01:05,369 INFO [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c5bf086f4d78d5798a092ee1346a2553 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-10-06 04:01:05,369 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-06 04:01:05,369 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:01:05,369 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-06 04:01:05,405 INFO [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310067e27db018b6049aab75f741ecfa47512 to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310067e27db018b6049aab75f741ecfa47512 2023-10-06 04:01:05,405 INFO [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023100604a3bd1619324e71a45af8b5bc14f484 to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100604a3bd1619324e71a45af8b5bc14f484 2023-10-06 04:01:05,430 INFO [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testConsecutiveExports/c5bf086f4d78d5798a092ee1346a2553/.tmp/cf/539bb2cbe53a421aa5245312dfe27699 2023-10-06 04:01:05,430 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 04:01:05,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-06 04:01:05,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-06 04:01:05,432 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 04:01:05,433 INFO [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testConsecutiveExports/001626deeb8557f9f4ff6e6ee887a80e/.tmp/cf/7b0d0e736ed74e8aadd6a44e2457cda6 2023-10-06 04:01:05,439 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testConsecutiveExports/c5bf086f4d78d5798a092ee1346a2553/.tmp/cf/539bb2cbe53a421aa5245312dfe27699 as hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testConsecutiveExports/c5bf086f4d78d5798a092ee1346a2553/cf/539bb2cbe53a421aa5245312dfe27699 2023-10-06 04:01:05,439 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testConsecutiveExports/001626deeb8557f9f4ff6e6ee887a80e/.tmp/cf/7b0d0e736ed74e8aadd6a44e2457cda6 as hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testConsecutiveExports/001626deeb8557f9f4ff6e6ee887a80e/cf/7b0d0e736ed74e8aadd6a44e2457cda6 2023-10-06 04:01:05,445 INFO [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testConsecutiveExports/c5bf086f4d78d5798a092ee1346a2553/cf/539bb2cbe53a421aa5245312dfe27699, entries=6, sequenceid=6, filesize=5.9 K 2023-10-06 04:01:05,446 INFO [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for c5bf086f4d78d5798a092ee1346a2553 in 77ms, sequenceid=6, compaction requested=false 2023-10-06 04:01:05,446 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-10-06 04:01:05,446 INFO [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testConsecutiveExports/001626deeb8557f9f4ff6e6ee887a80e/cf/7b0d0e736ed74e8aadd6a44e2457cda6, entries=44, sequenceid=6, filesize=12.2 K 2023-10-06 04:01:05,446 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c5bf086f4d78d5798a092ee1346a2553: 2023-10-06 04:01:05,447 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-06 04:01:05,447 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 04:01:05,447 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testConsecutiveExports/c5bf086f4d78d5798a092ee1346a2553/cf/539bb2cbe53a421aa5245312dfe27699] hfiles 2023-10-06 04:01:05,447 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testConsecutiveExports/c5bf086f4d78d5798a092ee1346a2553/cf/539bb2cbe53a421aa5245312dfe27699 for snapshot=snaptb0-testConsecutiveExports 2023-10-06 04:01:05,447 INFO [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 001626deeb8557f9f4ff6e6ee887a80e in 79ms, sequenceid=6, compaction requested=false 2023-10-06 04:01:05,449 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 001626deeb8557f9f4ff6e6ee887a80e: 2023-10-06 04:01:05,449 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-06 04:01:05,449 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 04:01:05,449 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testConsecutiveExports/001626deeb8557f9f4ff6e6ee887a80e/cf/7b0d0e736ed74e8aadd6a44e2457cda6] hfiles 2023-10-06 04:01:05,449 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testConsecutiveExports/001626deeb8557f9f4ff6e6ee887a80e/cf/7b0d0e736ed74e8aadd6a44e2457cda6 for snapshot=snaptb0-testConsecutiveExports 2023-10-06 04:01:05,464 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e. completed. 2023-10-06 04:01:05,464 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e. 2023-10-06 04:01:05,464 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 04:01:05,464 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 04:01:05,464 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:05,465 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-06 04:01:05,465 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38169,1696564824132' in zk 2023-10-06 04:01:05,467 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:05,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:05,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:01:05,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:01:05,467 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-06 04:01:05,467 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:01:05,467 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-06 04:01:05,469 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553. completed. 2023-10-06 04:01:05,469 DEBUG [rs(jenkins-hbase4.apache.org,36359,1696564824167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553. 2023-10-06 04:01:05,469 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 04:01:05,469 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 04:01:05,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:01:05,470 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:05,470 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-06 04:01:05,470 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36359,1696564824167' in zk 2023-10-06 04:01:05,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:01:05,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-06 04:01:05,472 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:05,472 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-06 04:01:05,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:05,472 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:01:05,472 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-06 04:01:05,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:05,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:05,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:01:05,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-06 04:01:05,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:05,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:05,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:05,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,38169,1696564824132': 2023-10-06 04:01:05,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38169,1696564824132' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-06 04:01:05,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:05,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:01:05,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:01:05,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:01:05,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:01:05,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-06 04:01:05,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:05,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:05,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:05,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:01:05,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-06 04:01:05,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:05,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:05,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:05,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,36359,1696564824167': 2023-10-06 04:01:05,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36359,1696564824167' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-06 04:01:05,481 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-10-06 04:01:05,481 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 04:01:05,481 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 04:01:05,481 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-10-06 04:01:05,481 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 04:01:05,483 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,483 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,483 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:05,483 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:05,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,483 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,483 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,483 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:05,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:01:05,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:01:05,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:05,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:05,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:05,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:05,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:05,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:01:05,484 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:05,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:05,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-06 04:01:05,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,484 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:05,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:01:05,485 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:05,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-06 04:01:05,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:05,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:05,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:05,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:01:05,487 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:05,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-06 04:01:05,487 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:05,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:05,487 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:05,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:05,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:05,493 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:05,493 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:05,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:05,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:05,493 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:05,494 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:05,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:05,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:05,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:05,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:05,494 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:05,494 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:05,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:05,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:05,494 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:05,494 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,494 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:05,494 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:05,494 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,494 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:05,494 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,494 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:05,494 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-10-06 04:01:05,494 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:01:05,495 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-06 04:01:05,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:05,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-06 04:01:05,494 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:05,497 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 04:01:05,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:05,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:05,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:05,497 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,497 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,498 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100604a3bd1619324e71a45af8b5bc14f484, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310067e27db018b6049aab75f741ecfa47512] mob files 2023-10-06 04:01:05,498 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100604a3bd1619324e71a45af8b5bc14f484 2023-10-06 04:01:05,498 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310067e27db018b6049aab75f741ecfa47512 2023-10-06 04:01:05,515 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-10-06 04:01:05,516 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,542 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,543 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-06 04:01:05,543 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,544 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,544 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696564865328Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696564865515 (+187 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1696564865515Loading Region manifests for snaptb0-testConsecutiveExports at 1696564865515Writing data manifest for snaptb0-testConsecutiveExports at 1696564865520 (+5 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1696564865534 (+14 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696564865543 (+9 ms) 2023-10-06 04:01:05,547 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-06 04:01:05,548 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 218 msec 2023-10-06 04:01:05,633 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 04:01:05,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-06 04:01:05,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 04:01:05,634 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/local-export-1696564865634 2023-10-06 04:01:05,634 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/local-export-1696564865634, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/local-export-1696564865634, srcFsUri=hdfs://localhost:42421, srcDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91 2023-10-06 04:01:05,667 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42421, inputRoot=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91 2023-10-06 04:01:05,668 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@6c667747, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/local-export-1696564865634, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/local-export-1696564865634/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,668 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42421, inputRoot=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91, snapshotDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-06 04:01:05,678 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/local-export-1696564865634/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-06 04:01:05,691 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:05,692 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:05,692 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:05,693 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:05,693 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:05,694 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:05,694 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:05,775 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/hadoop-5931140607176587823.jar 2023-10-06 04:01:05,776 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:05,777 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:05,777 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:05,778 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:05,778 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:05,778 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:05,779 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-06 04:01:05,779 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-06 04:01:05,779 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-06 04:01:05,780 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-06 04:01:05,780 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-06 04:01:05,781 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-06 04:01:05,781 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-06 04:01:05,781 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-06 04:01:05,782 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-06 04:01:05,782 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-06 04:01:05,782 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 04:01:05,783 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 04:01:05,783 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 04:01:05,783 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 04:01:05,784 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 04:01:05,784 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 04:01:05,784 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 04:01:06,167 WARN [Listener at jenkins-hbase4.apache.org/34869] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-06 04:01:06,170 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-06 04:01:06,172 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-06 04:01:07,977 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 04:01:07,977 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 04:01:07,984 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696564830351_0002_000001 (auth:SIMPLE) 2023-10-06 04:01:08,767 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696564830351_0003_000001 (auth:SIMPLE) 2023-10-06 04:01:09,573 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-06 04:01:12,597 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696564830351_0003_000001 (auth:SIMPLE) 2023-10-06 04:01:14,839 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696564830351_0003_000001 (auth:SIMPLE) 2023-10-06 04:01:19,342 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-06 04:01:19,343 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-06 04:01:19,348 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-06 04:01:19,348 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-06 04:01:19,349 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-06 04:01:19,349 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1023520784_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-06 04:01:19,351 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(367): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-06 04:01:19,352 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(367): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-06 04:01:19,352 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@656a0d13 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/local-export-1696564865634/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/local-export-1696564865634/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-06 04:01:19,352 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/local-export-1696564865634/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-06 04:01:19,352 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/local-export-1696564865634/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-06 04:01:19,353 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/local-export-1696564865634, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/local-export-1696564865634, srcFsUri=hdfs://localhost:42421, srcDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91 2023-10-06 04:01:19,375 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42421, inputRoot=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91 2023-10-06 04:01:19,375 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@7b96abbc, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/local-export-1696564865634, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/local-export-1696564865634/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-06 04:01:19,375 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42421, inputRoot=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91, snapshotDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-06 04:01:19,389 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/local-export-1696564865634/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-06 04:01:19,401 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:19,402 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:19,402 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:19,403 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:19,403 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:19,404 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:19,404 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:19,473 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/hadoop-3091211305582607472.jar 2023-10-06 04:01:19,473 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:19,473 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:19,474 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:19,474 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:19,474 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:19,475 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:19,475 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-06 04:01:19,475 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-06 04:01:19,476 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-06 04:01:19,476 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-06 04:01:19,477 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-06 04:01:19,477 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-06 04:01:19,478 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-06 04:01:19,478 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-06 04:01:19,479 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-06 04:01:19,480 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-06 04:01:19,480 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 04:01:19,481 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 04:01:19,481 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 04:01:19,482 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 04:01:19,482 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 04:01:19,483 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 04:01:19,483 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 04:01:19,852 WARN [Listener at jenkins-hbase4.apache.org/34869] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-06 04:01:19,854 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-06 04:01:19,857 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-06 04:01:24,054 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 04:01:24,054 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 04:01:24,057 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696564830351_0003_000001 (auth:SIMPLE) 2023-10-06 04:01:24,990 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696564830351_0004_000001 (auth:SIMPLE) 2023-10-06 04:01:28,616 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696564830351_0004_000001 (auth:SIMPLE) 2023-10-06 04:01:30,850 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696564830351_0004_000001 (auth:SIMPLE) 2023-10-06 04:01:33,058 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696564830351_0004_000001 (auth:SIMPLE) 2023-10-06 04:01:35,034 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-06 04:01:35,034 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-06 04:01:35,038 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-06 04:01:35,038 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-06 04:01:35,038 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-06 04:01:35,038 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1023520784_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-06 04:01:35,042 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(367): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-06 04:01:35,042 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(367): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-06 04:01:35,042 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@656a0d13 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/local-export-1696564865634/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/local-export-1696564865634/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-06 04:01:35,042 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/local-export-1696564865634/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-06 04:01:35,042 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/local-export-1696564865634/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-06 04:01:35,054 INFO [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-10-06 04:01:35,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-10-06 04:01:35,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-10-06 04:01:35,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-06 04:01:35,059 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696564895059"}]},"ts":"1696564895059"} 2023-10-06 04:01:35,061 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-10-06 04:01:35,063 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-10-06 04:01:35,063 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c5bf086f4d78d5798a092ee1346a2553, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=001626deeb8557f9f4ff6e6ee887a80e, UNASSIGN}] 2023-10-06 04:01:35,066 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c5bf086f4d78d5798a092ee1346a2553, UNASSIGN 2023-10-06 04:01:35,066 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=001626deeb8557f9f4ff6e6ee887a80e, UNASSIGN 2023-10-06 04:01:35,066 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=c5bf086f4d78d5798a092ee1346a2553, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:35,066 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=001626deeb8557f9f4ff6e6ee887a80e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:35,067 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696564895066"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696564895066"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696564895066"}]},"ts":"1696564895066"} 2023-10-06 04:01:35,067 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696564895066"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696564895066"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696564895066"}]},"ts":"1696564895066"} 2023-10-06 04:01:35,068 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure c5bf086f4d78d5798a092ee1346a2553, server=jenkins-hbase4.apache.org,36359,1696564824167}] 2023-10-06 04:01:35,069 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 001626deeb8557f9f4ff6e6ee887a80e, server=jenkins-hbase4.apache.org,38169,1696564824132}] 2023-10-06 04:01:35,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-06 04:01:35,220 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c5bf086f4d78d5798a092ee1346a2553 2023-10-06 04:01:35,220 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 001626deeb8557f9f4ff6e6ee887a80e 2023-10-06 04:01:35,220 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c5bf086f4d78d5798a092ee1346a2553, disabling compactions & flushes 2023-10-06 04:01:35,220 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 001626deeb8557f9f4ff6e6ee887a80e, disabling compactions & flushes 2023-10-06 04:01:35,220 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553. 2023-10-06 04:01:35,221 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e. 2023-10-06 04:01:35,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553. 2023-10-06 04:01:35,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e. 2023-10-06 04:01:35,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553. after waiting 0 ms 2023-10-06 04:01:35,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e. after waiting 0 ms 2023-10-06 04:01:35,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e. 2023-10-06 04:01:35,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553. 2023-10-06 04:01:35,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testConsecutiveExports/001626deeb8557f9f4ff6e6ee887a80e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 04:01:35,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testConsecutiveExports/c5bf086f4d78d5798a092ee1346a2553/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 04:01:35,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 04:01:35,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 04:01:35,231 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e. 2023-10-06 04:01:35,231 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553. 2023-10-06 04:01:35,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c5bf086f4d78d5798a092ee1346a2553: 2023-10-06 04:01:35,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 001626deeb8557f9f4ff6e6ee887a80e: 2023-10-06 04:01:35,233 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c5bf086f4d78d5798a092ee1346a2553 2023-10-06 04:01:35,234 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=c5bf086f4d78d5798a092ee1346a2553, regionState=CLOSED 2023-10-06 04:01:35,234 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 001626deeb8557f9f4ff6e6ee887a80e 2023-10-06 04:01:35,234 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696564895234"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696564895234"}]},"ts":"1696564895234"} 2023-10-06 04:01:35,234 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=001626deeb8557f9f4ff6e6ee887a80e, regionState=CLOSED 2023-10-06 04:01:35,234 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696564895234"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696564895234"}]},"ts":"1696564895234"} 2023-10-06 04:01:35,237 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-10-06 04:01:35,238 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure c5bf086f4d78d5798a092ee1346a2553, server=jenkins-hbase4.apache.org,36359,1696564824167 in 167 msec 2023-10-06 04:01:35,238 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-10-06 04:01:35,238 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 001626deeb8557f9f4ff6e6ee887a80e, server=jenkins-hbase4.apache.org,38169,1696564824132 in 167 msec 2023-10-06 04:01:35,239 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c5bf086f4d78d5798a092ee1346a2553, UNASSIGN in 175 msec 2023-10-06 04:01:35,240 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-10-06 04:01:35,240 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=001626deeb8557f9f4ff6e6ee887a80e, UNASSIGN in 175 msec 2023-10-06 04:01:35,240 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696564895240"}]},"ts":"1696564895240"} 2023-10-06 04:01:35,242 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-10-06 04:01:35,243 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-10-06 04:01:35,245 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 189 msec 2023-10-06 04:01:35,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-06 04:01:35,362 INFO [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-10-06 04:01:35,363 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-10-06 04:01:35,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-06 04:01:35,366 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-06 04:01:35,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-10-06 04:01:35,367 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-06 04:01:35,369 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36351] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-10-06 04:01:35,373 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testConsecutiveExports/c5bf086f4d78d5798a092ee1346a2553 2023-10-06 04:01:35,373 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testConsecutiveExports/001626deeb8557f9f4ff6e6ee887a80e 2023-10-06 04:01:35,373 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-06 04:01:35,373 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-06 04:01:35,373 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-06 04:01:35,373 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-06 04:01:35,374 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-06 04:01:35,374 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-06 04:01:35,374 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-06 04:01:35,375 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-06 04:01:35,376 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-06 04:01:35,376 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-06 04:01:35,376 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-06 04:01:35,376 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:01:35,376 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testConsecutiveExports/c5bf086f4d78d5798a092ee1346a2553/cf, FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testConsecutiveExports/c5bf086f4d78d5798a092ee1346a2553/recovered.edits] 2023-10-06 04:01:35,376 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:01:35,376 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:01:35,376 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-06 04:01:35,376 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:01:35,377 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testConsecutiveExports/001626deeb8557f9f4ff6e6ee887a80e/cf, FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testConsecutiveExports/001626deeb8557f9f4ff6e6ee887a80e/recovered.edits] 2023-10-06 04:01:35,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-06 04:01:35,382 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testConsecutiveExports/c5bf086f4d78d5798a092ee1346a2553/cf/539bb2cbe53a421aa5245312dfe27699 to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testConsecutiveExports/c5bf086f4d78d5798a092ee1346a2553/cf/539bb2cbe53a421aa5245312dfe27699 2023-10-06 04:01:35,383 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testConsecutiveExports/001626deeb8557f9f4ff6e6ee887a80e/cf/7b0d0e736ed74e8aadd6a44e2457cda6 to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testConsecutiveExports/001626deeb8557f9f4ff6e6ee887a80e/cf/7b0d0e736ed74e8aadd6a44e2457cda6 2023-10-06 04:01:35,386 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testConsecutiveExports/c5bf086f4d78d5798a092ee1346a2553/recovered.edits/9.seqid to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testConsecutiveExports/c5bf086f4d78d5798a092ee1346a2553/recovered.edits/9.seqid 2023-10-06 04:01:35,386 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testConsecutiveExports/c5bf086f4d78d5798a092ee1346a2553 2023-10-06 04:01:35,387 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testConsecutiveExports/001626deeb8557f9f4ff6e6ee887a80e/recovered.edits/9.seqid to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testConsecutiveExports/001626deeb8557f9f4ff6e6ee887a80e/recovered.edits/9.seqid 2023-10-06 04:01:35,387 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testConsecutiveExports/001626deeb8557f9f4ff6e6ee887a80e 2023-10-06 04:01:35,387 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-06 04:01:35,388 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-06 04:01:35,389 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-10-06 04:01:35,392 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100604a3bd1619324e71a45af8b5bc14f484 to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100604a3bd1619324e71a45af8b5bc14f484 2023-10-06 04:01:35,394 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310067e27db018b6049aab75f741ecfa47512 to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310067e27db018b6049aab75f741ecfa47512 2023-10-06 04:01:35,394 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-06 04:01:35,396 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-06 04:01:35,399 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-10-06 04:01:35,401 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-10-06 04:01:35,403 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-06 04:01:35,403 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-10-06 04:01:35,403 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696564895403"}]},"ts":"9223372036854775807"} 2023-10-06 04:01:35,403 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696564895403"}]},"ts":"9223372036854775807"} 2023-10-06 04:01:35,405 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-06 04:01:35,405 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c5bf086f4d78d5798a092ee1346a2553, NAME => 'testtb-testConsecutiveExports,,1696564864289.c5bf086f4d78d5798a092ee1346a2553.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 001626deeb8557f9f4ff6e6ee887a80e, NAME => 'testtb-testConsecutiveExports,1,1696564864289.001626deeb8557f9f4ff6e6ee887a80e.', STARTKEY => '1', ENDKEY => ''}] 2023-10-06 04:01:35,405 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-10-06 04:01:35,405 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696564895405"}]},"ts":"9223372036854775807"} 2023-10-06 04:01:35,407 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-10-06 04:01:35,409 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-06 04:01:35,410 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 46 msec 2023-10-06 04:01:35,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-06 04:01:35,479 INFO [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-10-06 04:01:35,489 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-10-06 04:01:35,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-10-06 04:01:35,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-10-06 04:01:35,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testConsecutiveExports 2023-10-06 04:01:35,520 INFO [Listener at jenkins-hbase4.apache.org/34869] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=747 (was 761), OpenFileDescriptor=902 (was 935), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=241 (was 310), ProcessCount=168 (was 168), AvailableMemoryMB=5818 (was 5971) 2023-10-06 04:01:35,520 WARN [Listener at jenkins-hbase4.apache.org/34869] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-10-06 04:01:35,539 INFO [Listener at jenkins-hbase4.apache.org/34869] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=747, OpenFileDescriptor=902, MaxFileDescriptor=60000, SystemLoadAverage=241, ProcessCount=168, AvailableMemoryMB=5817 2023-10-06 04:01:35,539 WARN [Listener at jenkins-hbase4.apache.org/34869] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-10-06 04:01:35,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-06 04:01:35,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:35,544 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-10-06 04:01:35,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-10-06 04:01:35,545 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-06 04:01:35,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-06 04:01:35,547 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5a5c6a411d7f75f638a87bfbed44d9d9 2023-10-06 04:01:35,547 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f1de060f8661341540e36a0da57c77f 2023-10-06 04:01:35,548 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5a5c6a411d7f75f638a87bfbed44d9d9 empty. 2023-10-06 04:01:35,548 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f1de060f8661341540e36a0da57c77f empty. 2023-10-06 04:01:35,548 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5a5c6a411d7f75f638a87bfbed44d9d9 2023-10-06 04:01:35,549 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f1de060f8661341540e36a0da57c77f 2023-10-06 04:01:35,549 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-06 04:01:35,564 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-10-06 04:01:35,565 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6f1de060f8661341540e36a0da57c77f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp 2023-10-06 04:01:35,565 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5a5c6a411d7f75f638a87bfbed44d9d9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp 2023-10-06 04:01:35,585 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:01:35,586 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 6f1de060f8661341540e36a0da57c77f, disabling compactions & flushes 2023-10-06 04:01:35,586 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f. 2023-10-06 04:01:35,586 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f. 2023-10-06 04:01:35,586 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f. after waiting 0 ms 2023-10-06 04:01:35,586 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f. 2023-10-06 04:01:35,586 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f. 2023-10-06 04:01:35,586 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 6f1de060f8661341540e36a0da57c77f: 2023-10-06 04:01:35,594 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:01:35,594 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 5a5c6a411d7f75f638a87bfbed44d9d9, disabling compactions & flushes 2023-10-06 04:01:35,594 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9. 2023-10-06 04:01:35,594 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9. 2023-10-06 04:01:35,594 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9. after waiting 0 ms 2023-10-06 04:01:35,594 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9. 2023-10-06 04:01:35,594 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9. 2023-10-06 04:01:35,594 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 5a5c6a411d7f75f638a87bfbed44d9d9: 2023-10-06 04:01:35,597 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-10-06 04:01:35,598 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696564895598"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696564895598"}]},"ts":"1696564895598"} 2023-10-06 04:01:35,598 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696564895598"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696564895598"}]},"ts":"1696564895598"} 2023-10-06 04:01:35,606 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-06 04:01:35,607 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-06 04:01:35,607 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696564895607"}]},"ts":"1696564895607"} 2023-10-06 04:01:35,608 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-10-06 04:01:35,612 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-06 04:01:35,613 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-06 04:01:35,613 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-06 04:01:35,613 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-06 04:01:35,613 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-06 04:01:35,614 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5a5c6a411d7f75f638a87bfbed44d9d9, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6f1de060f8661341540e36a0da57c77f, ASSIGN}] 2023-10-06 04:01:35,616 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6f1de060f8661341540e36a0da57c77f, ASSIGN 2023-10-06 04:01:35,616 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5a5c6a411d7f75f638a87bfbed44d9d9, ASSIGN 2023-10-06 04:01:35,617 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6f1de060f8661341540e36a0da57c77f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38169,1696564824132; forceNewPlan=false, retain=false 2023-10-06 04:01:35,617 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5a5c6a411d7f75f638a87bfbed44d9d9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36351,1696564824083; forceNewPlan=false, retain=false 2023-10-06 04:01:35,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-06 04:01:35,767 INFO [jenkins-hbase4:45627] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-06 04:01:35,770 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=5a5c6a411d7f75f638a87bfbed44d9d9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:35,770 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=6f1de060f8661341540e36a0da57c77f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:35,770 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696564895770"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696564895770"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696564895770"}]},"ts":"1696564895770"} 2023-10-06 04:01:35,770 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696564895770"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696564895770"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696564895770"}]},"ts":"1696564895770"} 2023-10-06 04:01:35,772 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 6f1de060f8661341540e36a0da57c77f, server=jenkins-hbase4.apache.org,38169,1696564824132}] 2023-10-06 04:01:35,773 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 5a5c6a411d7f75f638a87bfbed44d9d9, server=jenkins-hbase4.apache.org,36351,1696564824083}] 2023-10-06 04:01:35,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-06 04:01:35,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f. 2023-10-06 04:01:35,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6f1de060f8661341540e36a0da57c77f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f.', STARTKEY => '1', ENDKEY => ''} 2023-10-06 04:01:35,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f. service=AccessControlService 2023-10-06 04:01:35,929 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 04:01:35,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 6f1de060f8661341540e36a0da57c77f 2023-10-06 04:01:35,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:01:35,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6f1de060f8661341540e36a0da57c77f 2023-10-06 04:01:35,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6f1de060f8661341540e36a0da57c77f 2023-10-06 04:01:35,930 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9. 2023-10-06 04:01:35,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5a5c6a411d7f75f638a87bfbed44d9d9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9.', STARTKEY => '', ENDKEY => '1'} 2023-10-06 04:01:35,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9. service=AccessControlService 2023-10-06 04:01:35,931 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 04:01:35,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 5a5c6a411d7f75f638a87bfbed44d9d9 2023-10-06 04:01:35,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:01:35,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5a5c6a411d7f75f638a87bfbed44d9d9 2023-10-06 04:01:35,931 INFO [StoreOpener-6f1de060f8661341540e36a0da57c77f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6f1de060f8661341540e36a0da57c77f 2023-10-06 04:01:35,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5a5c6a411d7f75f638a87bfbed44d9d9 2023-10-06 04:01:35,932 INFO [StoreOpener-5a5c6a411d7f75f638a87bfbed44d9d9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5a5c6a411d7f75f638a87bfbed44d9d9 2023-10-06 04:01:35,933 DEBUG [StoreOpener-6f1de060f8661341540e36a0da57c77f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f1de060f8661341540e36a0da57c77f/cf 2023-10-06 04:01:35,933 DEBUG [StoreOpener-6f1de060f8661341540e36a0da57c77f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f1de060f8661341540e36a0da57c77f/cf 2023-10-06 04:01:35,934 DEBUG [StoreOpener-5a5c6a411d7f75f638a87bfbed44d9d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion/5a5c6a411d7f75f638a87bfbed44d9d9/cf 2023-10-06 04:01:35,934 INFO [StoreOpener-6f1de060f8661341540e36a0da57c77f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6f1de060f8661341540e36a0da57c77f columnFamilyName cf 2023-10-06 04:01:35,934 DEBUG [StoreOpener-5a5c6a411d7f75f638a87bfbed44d9d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion/5a5c6a411d7f75f638a87bfbed44d9d9/cf 2023-10-06 04:01:35,935 INFO [StoreOpener-5a5c6a411d7f75f638a87bfbed44d9d9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a5c6a411d7f75f638a87bfbed44d9d9 columnFamilyName cf 2023-10-06 04:01:35,936 INFO [StoreOpener-6f1de060f8661341540e36a0da57c77f-1] regionserver.HStore(310): Store=6f1de060f8661341540e36a0da57c77f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 04:01:35,936 INFO [StoreOpener-5a5c6a411d7f75f638a87bfbed44d9d9-1] regionserver.HStore(310): Store=5a5c6a411d7f75f638a87bfbed44d9d9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 04:01:35,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f1de060f8661341540e36a0da57c77f 2023-10-06 04:01:35,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion/5a5c6a411d7f75f638a87bfbed44d9d9 2023-10-06 04:01:35,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f1de060f8661341540e36a0da57c77f 2023-10-06 04:01:35,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion/5a5c6a411d7f75f638a87bfbed44d9d9 2023-10-06 04:01:35,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5a5c6a411d7f75f638a87bfbed44d9d9 2023-10-06 04:01:35,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6f1de060f8661341540e36a0da57c77f 2023-10-06 04:01:35,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion/5a5c6a411d7f75f638a87bfbed44d9d9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 04:01:35,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f1de060f8661341540e36a0da57c77f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 04:01:35,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5a5c6a411d7f75f638a87bfbed44d9d9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66419200, jitterRate=-0.01027679443359375}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 04:01:35,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6f1de060f8661341540e36a0da57c77f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68137181, jitterRate=0.01532311737537384}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 04:01:35,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5a5c6a411d7f75f638a87bfbed44d9d9: 2023-10-06 04:01:35,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6f1de060f8661341540e36a0da57c77f: 2023-10-06 04:01:35,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9., pid=61, masterSystemTime=1696564895924 2023-10-06 04:01:35,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f., pid=60, masterSystemTime=1696564895923 2023-10-06 04:01:35,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9. 2023-10-06 04:01:35,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9. 2023-10-06 04:01:35,947 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=5a5c6a411d7f75f638a87bfbed44d9d9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:35,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f. 2023-10-06 04:01:35,947 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696564895946"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696564895946"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696564895946"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696564895946"}]},"ts":"1696564895946"} 2023-10-06 04:01:35,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f. 2023-10-06 04:01:35,947 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=6f1de060f8661341540e36a0da57c77f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:35,947 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696564895947"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696564895947"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696564895947"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696564895947"}]},"ts":"1696564895947"} 2023-10-06 04:01:35,950 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-10-06 04:01:35,950 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 5a5c6a411d7f75f638a87bfbed44d9d9, server=jenkins-hbase4.apache.org,36351,1696564824083 in 176 msec 2023-10-06 04:01:35,951 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-10-06 04:01:35,951 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 6f1de060f8661341540e36a0da57c77f, server=jenkins-hbase4.apache.org,38169,1696564824132 in 177 msec 2023-10-06 04:01:35,952 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5a5c6a411d7f75f638a87bfbed44d9d9, ASSIGN in 336 msec 2023-10-06 04:01:35,953 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-10-06 04:01:35,953 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6f1de060f8661341540e36a0da57c77f, ASSIGN in 337 msec 2023-10-06 04:01:35,954 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-06 04:01:35,954 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696564895954"}]},"ts":"1696564895954"} 2023-10-06 04:01:35,955 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-10-06 04:01:35,958 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-10-06 04:01:35,958 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-10-06 04:01:35,959 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36351] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-06 04:01:35,962 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:01:35,962 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:01:35,962 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:01:35,962 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:01:35,964 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 04:01:35,964 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 04:01:35,964 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 04:01:35,964 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 04:01:35,965 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 423 msec 2023-10-06 04:01:36,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-06 04:01:36,149 INFO [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-10-06 04:01:36,151 DEBUG [Listener at jenkins-hbase4.apache.org/34869] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,151 DEBUG [Listener at jenkins-hbase4.apache.org/34869] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9. 2023-10-06 04:01:36,154 INFO [Listener at jenkins-hbase4.apache.org/34869] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 04:01:36,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-06 04:01:36,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696564896165 (current time:1696564896165). 2023-10-06 04:01:36,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 04:01:36,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(139): Connect 0x47605938 to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 04:01:36,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@266e1830, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 04:01:36,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 04:01:36,179 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35614, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 04:01:36,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47605938 to 127.0.0.1:57105 2023-10-06 04:01:36,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:01:36,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(139): Connect 0x5452f9c8 to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 04:01:36,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@113ed3e3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 04:01:36,189 DEBUG [hconnection-0x47c7e66c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 04:01:36,191 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35622, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 04:01:36,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5452f9c8 to 127.0.0.1:57105 2023-10-06 04:01:36,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:01:36,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-06 04:01:36,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 04:01:36,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-06 04:01:36,199 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot, current working dir path: hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 04:01:36,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-06 04:01:36,201 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-06 04:01:36,201 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696565496201 2023-10-06 04:01:36,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-06 04:01:36,201 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,202 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 04:01:36,203 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 04:01:36,203 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-06 04:01:36,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-06 04:01:36,205 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-10-06 04:01:36,205 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-06 04:01:36,206 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696565496206 2023-10-06 04:01:36,216 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,216 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-06 04:01:36,216 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:01:36,217 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-06 04:01:36,217 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-06 04:01:36,218 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,218 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,219 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:36,219 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:36,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:36,219 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:36,219 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:36,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:36,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:36,220 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:36,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:36,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,220 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,220 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,220 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,220 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 04:01:36,220 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,220 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-06 04:01:36,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-06 04:01:36,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-06 04:01:36,221 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-06 04:01:36,221 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-06 04:01:36,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,221 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,221 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-06 04:01:36,221 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-06 04:01:36,221 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:01:36,221 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,221 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,222 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-06 04:01:36,222 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:01:36,222 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-06 04:01:36,222 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-06 04:01:36,222 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-06 04:01:36,223 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38169,1696564824132' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-06 04:01:36,223 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-06 04:01:36,224 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-06 04:01:36,224 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36359,1696564824167' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-06 04:01:36,223 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:01:36,225 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-06 04:01:36,225 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-06 04:01:36,225 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36351,1696564824083' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-06 04:01:36,228 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,228 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:01:36,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:01:36,230 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,230 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,230 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:01:36,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:01:36,230 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,230 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,230 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,230 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:01:36,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:01:36,230 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,231 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:01:36,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:36,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:01:36,232 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38169,1696564824132' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-06 04:01:36,232 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b55f788[Count = 1] remaining members to acquire global barrier 2023-10-06 04:01:36,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:01:36,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:01:36,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:01:36,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:01:36,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:36,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:01:36,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36351,1696564824083' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-06 04:01:36,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b55f788[Count = 0] remaining members to acquire global barrier 2023-10-06 04:01:36,234 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-06 04:01:36,234 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,236 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,236 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,236 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,236 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,236 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-06 04:01:36,236 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-06 04:01:36,236 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-06 04:01:36,236 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36359,1696564824167' in zk 2023-10-06 04:01:36,236 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-06 04:01:36,236 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,236 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 04:01:36,236 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 04:01:36,236 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 04:01:36,236 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 04:01:36,236 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 04:01:36,236 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9. 2023-10-06 04:01:36,236 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f. 2023-10-06 04:01:36,237 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9. started... 2023-10-06 04:01:36,237 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f. started... 2023-10-06 04:01:36,238 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5a5c6a411d7f75f638a87bfbed44d9d9: 2023-10-06 04:01:36,238 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6f1de060f8661341540e36a0da57c77f: 2023-10-06 04:01:36,238 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,238 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,238 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 04:01:36,238 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 04:01:36,238 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 04:01:36,238 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 04:01:36,241 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-06 04:01:36,241 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:01:36,241 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-06 04:01:36,247 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f. completed. 2023-10-06 04:01:36,247 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f. 2023-10-06 04:01:36,247 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9. completed. 2023-10-06 04:01:36,247 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 04:01:36,247 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 04:01:36,248 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,247 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9. 2023-10-06 04:01:36,248 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-06 04:01:36,248 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 04:01:36,248 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 04:01:36,248 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,248 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38169,1696564824132' in zk 2023-10-06 04:01:36,248 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-06 04:01:36,248 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36351,1696564824083' in zk 2023-10-06 04:01:36,251 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,251 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-06 04:01:36,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:01:36,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:01:36,251 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-06 04:01:36,251 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:01:36,251 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,251 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-06 04:01:36,251 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:01:36,252 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-06 04:01:36,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:01:36,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:01:36,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:36,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:01:36,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:36,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,38169,1696564824132': 2023-10-06 04:01:36,256 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38169,1696564824132' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-06 04:01:36,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:01:36,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:01:36,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:01:36,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:01:36,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:36,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:01:36,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:36,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,36351,1696564824083': 2023-10-06 04:01:36,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36351,1696564824083' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-06 04:01:36,260 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-06 04:01:36,260 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 04:01:36,260 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 04:01:36,260 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,260 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 04:01:36,261 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,261 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,261 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,261 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,262 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:36,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,262 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:36,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:01:36,262 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,262 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:36,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:01:36,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:36,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:36,262 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:01:36,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:36,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:36,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:36,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:36,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,263 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:36,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:01:36,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:36,265 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:01:36,265 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,265 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:36,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:36,268 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:36,268 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:36,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:36,268 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:36,268 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:36,268 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:36,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:36,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:36,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:36,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:36,268 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:36,268 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:36,268 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,268 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:01:36,268 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:36,268 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:36,269 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:36,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:36,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:36,269 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:36,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:36,270 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,270 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,270 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:36,270 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 04:01:36,270 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,270 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,270 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,270 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,271 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,271 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-06 04:01:36,284 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,285 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,303 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 04:01:36,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-06 04:01:36,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-06 04:01:36,304 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 04:01:36,305 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,305 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-06 04:01:36,305 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,306 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,306 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696564896202Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696564896284 (+82 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696564896284Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696564896284Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696564896288 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696564896299 (+11 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696564896305 (+6 ms) 2023-10-06 04:01:36,308 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-06 04:01:36,309 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 106 msec 2023-10-06 04:01:36,504 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 04:01:36,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-06 04:01:36,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 04:01:36,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36351] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 04:01:36,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38169] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 04:01:36,512 DEBUG [Listener at jenkins-hbase4.apache.org/34869] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,512 DEBUG [Listener at jenkins-hbase4.apache.org/34869] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9. 2023-10-06 04:01:36,512 INFO [Listener at jenkins-hbase4.apache.org/34869] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 04:01:36,522 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-06 04:01:36,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696564896522 (current time:1696564896522). 2023-10-06 04:01:36,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 04:01:36,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(139): Connect 0x7697ac0a to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 04:01:36,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6867197f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 04:01:36,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 04:01:36,532 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35638, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 04:01:36,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7697ac0a to 127.0.0.1:57105 2023-10-06 04:01:36,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:01:36,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(139): Connect 0x6af19091 to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 04:01:36,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21cd8639, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 04:01:36,541 DEBUG [hconnection-0x71b1cf9e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 04:01:36,543 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35642, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 04:01:36,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6af19091 to 127.0.0.1:57105 2023-10-06 04:01:36,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:01:36,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-06 04:01:36,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 04:01:36,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-06 04:01:36,550 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot, current working dir path: hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 04:01:36,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-06 04:01:36,552 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-06 04:01:36,553 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696565496553 2023-10-06 04:01:36,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-06 04:01:36,553 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,554 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 04:01:36,554 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 04:01:36,555 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-06 04:01:36,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-06 04:01:36,556 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 4 msec 2023-10-06 04:01:36,557 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-06 04:01:36,557 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696565496557 2023-10-06 04:01:36,567 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,567 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-06 04:01:36,567 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:01:36,568 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-06 04:01:36,568 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-06 04:01:36,569 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,569 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,570 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:36,570 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,570 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:36,570 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:36,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:36,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:36,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:36,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:36,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:36,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:36,571 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,571 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,571 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,571 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 04:01:36,571 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,572 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,572 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-06 04:01:36,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-06 04:01:36,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-06 04:01:36,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,572 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-06 04:01:36,572 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-06 04:01:36,572 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-06 04:01:36,572 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,572 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-06 04:01:36,572 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,572 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:01:36,573 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-06 04:01:36,574 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-06 04:01:36,573 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,574 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-06 04:01:36,574 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:01:36,574 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36359,1696564824167' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-06 04:01:36,575 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-06 04:01:36,575 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-06 04:01:36,575 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36351,1696564824083' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-06 04:01:36,574 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-06 04:01:36,575 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:01:36,576 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-06 04:01:36,576 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-06 04:01:36,576 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38169,1696564824132' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-06 04:01:36,578 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,578 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,578 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:01:36,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:01:36,579 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,579 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:01:36,579 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,579 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:01:36,579 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:01:36,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:01:36,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:36,581 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:01:36,581 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,581 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:01:36,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36351,1696564824083' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-06 04:01:36,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@271385b5[Count = 1] remaining members to acquire global barrier 2023-10-06 04:01:36,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:01:36,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:01:36,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:01:36,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:01:36,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:36,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:01:36,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38169,1696564824132' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-06 04:01:36,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@271385b5[Count = 0] remaining members to acquire global barrier 2023-10-06 04:01:36,584 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-06 04:01:36,584 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,585 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,585 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,585 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,585 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,585 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-06 04:01:36,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,585 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-06 04:01:36,586 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-06 04:01:36,586 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,586 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 04:01:36,586 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 04:01:36,586 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 04:01:36,586 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 04:01:36,586 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9. 2023-10-06 04:01:36,586 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-06 04:01:36,586 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9. started... 2023-10-06 04:01:36,586 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36359,1696564824167' in zk 2023-10-06 04:01:36,586 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 04:01:36,586 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f. 2023-10-06 04:01:36,586 INFO [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5a5c6a411d7f75f638a87bfbed44d9d9 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-06 04:01:36,586 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f. started... 2023-10-06 04:01:36,586 INFO [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6f1de060f8661341540e36a0da57c77f 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-06 04:01:36,588 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-06 04:01:36,588 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:01:36,588 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-06 04:01:36,605 INFO [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231006afbe25bc5b2342af908e4c557ba7b67b to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231006afbe25bc5b2342af908e4c557ba7b67b 2023-10-06 04:01:36,608 INFO [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231006da9e0e8e8d224765baa3dc3feeedc830 to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231006da9e0e8e8d224765baa3dc3feeedc830 2023-10-06 04:01:36,616 INFO [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion/5a5c6a411d7f75f638a87bfbed44d9d9/.tmp/cf/1514f15c45e3407cafe3779a473ab8b3 2023-10-06 04:01:36,618 INFO [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f1de060f8661341540e36a0da57c77f/.tmp/cf/8a26f8575ee645609e0c37c964ef1a62 2023-10-06 04:01:36,621 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion/5a5c6a411d7f75f638a87bfbed44d9d9/.tmp/cf/1514f15c45e3407cafe3779a473ab8b3 as hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion/5a5c6a411d7f75f638a87bfbed44d9d9/cf/1514f15c45e3407cafe3779a473ab8b3 2023-10-06 04:01:36,623 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f1de060f8661341540e36a0da57c77f/.tmp/cf/8a26f8575ee645609e0c37c964ef1a62 as hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f1de060f8661341540e36a0da57c77f/cf/8a26f8575ee645609e0c37c964ef1a62 2023-10-06 04:01:36,626 INFO [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion/5a5c6a411d7f75f638a87bfbed44d9d9/cf/1514f15c45e3407cafe3779a473ab8b3, entries=4, sequenceid=6, filesize=5.6 K 2023-10-06 04:01:36,627 INFO [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 5a5c6a411d7f75f638a87bfbed44d9d9 in 41ms, sequenceid=6, compaction requested=false 2023-10-06 04:01:36,627 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-10-06 04:01:36,628 INFO [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f1de060f8661341540e36a0da57c77f/cf/8a26f8575ee645609e0c37c964ef1a62, entries=46, sequenceid=6, filesize=13.4 K 2023-10-06 04:01:36,628 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5a5c6a411d7f75f638a87bfbed44d9d9: 2023-10-06 04:01:36,628 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,628 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 04:01:36,629 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion/5a5c6a411d7f75f638a87bfbed44d9d9/cf/1514f15c45e3407cafe3779a473ab8b3] hfiles 2023-10-06 04:01:36,629 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion/5a5c6a411d7f75f638a87bfbed44d9d9/cf/1514f15c45e3407cafe3779a473ab8b3 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,629 INFO [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 6f1de060f8661341540e36a0da57c77f in 43ms, sequenceid=6, compaction requested=false 2023-10-06 04:01:36,630 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6f1de060f8661341540e36a0da57c77f: 2023-10-06 04:01:36,631 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,631 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 04:01:36,631 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f1de060f8661341540e36a0da57c77f/cf/8a26f8575ee645609e0c37c964ef1a62] hfiles 2023-10-06 04:01:36,631 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f1de060f8661341540e36a0da57c77f/cf/8a26f8575ee645609e0c37c964ef1a62 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,641 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9. completed. 2023-10-06 04:01:36,641 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9. 2023-10-06 04:01:36,641 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 04:01:36,641 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 04:01:36,641 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,641 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-06 04:01:36,641 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36351,1696564824083' in zk 2023-10-06 04:01:36,641 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f. completed. 2023-10-06 04:01:36,641 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f. 2023-10-06 04:01:36,642 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 04:01:36,642 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 04:01:36,642 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,642 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-06 04:01:36,642 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38169,1696564824132' in zk 2023-10-06 04:01:36,644 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,644 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-06 04:01:36,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,644 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:01:36,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:01:36,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:01:36,644 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-06 04:01:36,646 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,647 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-06 04:01:36,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:01:36,647 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:01:36,647 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-06 04:01:36,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:01:36,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:36,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:01:36,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:36,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,36351,1696564824083': 2023-10-06 04:01:36,651 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36351,1696564824083' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-06 04:01:36,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:01:36,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:01:36,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:01:36,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:01:36,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:36,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:01:36,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:36,654 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 04:01:36,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,38169,1696564824132': 2023-10-06 04:01:36,655 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38169,1696564824132' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-06 04:01:36,655 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-06 04:01:36,655 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 04:01:36,655 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 04:01:36,655 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,655 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 04:01:36,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-06 04:01:36,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-06 04:01:36,656 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 04:01:36,659 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,659 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,659 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,659 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,659 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:36,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:01:36,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:01:36,659 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:36,660 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:36,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:36,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:01:36,659 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:36,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:36,660 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:36,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:36,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:36,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,660 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:36,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:01:36,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,662 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:36,662 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:01:36,663 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:36,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:36,666 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:36,666 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:36,666 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:36,667 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:36,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:36,667 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:36,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:36,667 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:36,667 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:01:36,667 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,666 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:36,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:36,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:36,668 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,667 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:36,668 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,668 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:36,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:36,668 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:36,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:36,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:36,669 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,669 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:36,669 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 04:01:36,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:36,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:36,669 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,669 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:36,669 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:36,669 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,669 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,670 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231006da9e0e8e8d224765baa3dc3feeedc830, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231006afbe25bc5b2342af908e4c557ba7b67b] mob files 2023-10-06 04:01:36,670 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231006da9e0e8e8d224765baa3dc3feeedc830 2023-10-06 04:01:36,670 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231006afbe25bc5b2342af908e4c557ba7b67b 2023-10-06 04:01:36,677 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,678 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,694 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,694 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-06 04:01:36,694 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,695 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:36,695 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696564896553Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696564896677 (+124 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696564896677Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1696564896677Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1696564896680 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696564896687 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696564896694 (+7 ms) 2023-10-06 04:01:36,697 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-06 04:01:36,699 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 144 msec 2023-10-06 04:01:36,856 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 04:01:36,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-06 04:01:36,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 04:01:36,886 DEBUG [Listener at jenkins-hbase4.apache.org/34869] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-06 04:01:36,891 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35644, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-06 04:01:36,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36351] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-06 04:01:36,893 DEBUG [Listener at jenkins-hbase4.apache.org/34869] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-06 04:01:36,897 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53210, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-06 04:01:36,897 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36359] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-06 04:01:36,897 DEBUG [Listener at jenkins-hbase4.apache.org/34869] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-06 04:01:36,900 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46758, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-06 04:01:36,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38169] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-06 04:01:36,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-06 04:01:36,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:36,904 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-10-06 04:01:36,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-10-06 04:01:36,905 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-06 04:01:36,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-06 04:01:36,908 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3f42b26e6f174cf9445a083febef25eb 2023-10-06 04:01:36,908 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/105af8bdc86c6081580078f7e20ae231 2023-10-06 04:01:36,908 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3f42b26e6f174cf9445a083febef25eb empty. 2023-10-06 04:01:36,909 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/105af8bdc86c6081580078f7e20ae231 empty. 2023-10-06 04:01:36,909 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3f42b26e6f174cf9445a083febef25eb 2023-10-06 04:01:36,909 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/105af8bdc86c6081580078f7e20ae231 2023-10-06 04:01:36,909 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-06 04:01:36,918 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-10-06 04:01:36,920 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3f42b26e6f174cf9445a083febef25eb, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896901.3f42b26e6f174cf9445a083febef25eb.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp 2023-10-06 04:01:36,920 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 105af8bdc86c6081580078f7e20ae231, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696564896901.105af8bdc86c6081580078f7e20ae231.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp 2023-10-06 04:01:36,929 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696564896901.105af8bdc86c6081580078f7e20ae231.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:01:36,929 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 105af8bdc86c6081580078f7e20ae231, disabling compactions & flushes 2023-10-06 04:01:36,929 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696564896901.105af8bdc86c6081580078f7e20ae231. 2023-10-06 04:01:36,929 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896901.3f42b26e6f174cf9445a083febef25eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:01:36,929 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696564896901.105af8bdc86c6081580078f7e20ae231. 2023-10-06 04:01:36,929 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 3f42b26e6f174cf9445a083febef25eb, disabling compactions & flushes 2023-10-06 04:01:36,929 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696564896901.105af8bdc86c6081580078f7e20ae231. after waiting 0 ms 2023-10-06 04:01:36,929 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896901.3f42b26e6f174cf9445a083febef25eb. 2023-10-06 04:01:36,929 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696564896901.105af8bdc86c6081580078f7e20ae231. 2023-10-06 04:01:36,929 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896901.3f42b26e6f174cf9445a083febef25eb. 2023-10-06 04:01:36,930 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696564896901.105af8bdc86c6081580078f7e20ae231. 2023-10-06 04:01:36,930 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896901.3f42b26e6f174cf9445a083febef25eb. after waiting 0 ms 2023-10-06 04:01:36,930 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896901.3f42b26e6f174cf9445a083febef25eb. 2023-10-06 04:01:36,930 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 105af8bdc86c6081580078f7e20ae231: 2023-10-06 04:01:36,930 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896901.3f42b26e6f174cf9445a083febef25eb. 2023-10-06 04:01:36,930 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 3f42b26e6f174cf9445a083febef25eb: 2023-10-06 04:01:36,932 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-10-06 04:01:36,933 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696564896901.105af8bdc86c6081580078f7e20ae231.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696564896933"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696564896933"}]},"ts":"1696564896933"} 2023-10-06 04:01:36,933 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896901.3f42b26e6f174cf9445a083febef25eb.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696564896933"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696564896933"}]},"ts":"1696564896933"} 2023-10-06 04:01:36,935 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-06 04:01:36,936 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-06 04:01:36,936 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696564896936"}]},"ts":"1696564896936"} 2023-10-06 04:01:36,937 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-10-06 04:01:36,941 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-06 04:01:36,942 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-06 04:01:36,942 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-06 04:01:36,942 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-06 04:01:36,942 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-06 04:01:36,942 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3f42b26e6f174cf9445a083febef25eb, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=105af8bdc86c6081580078f7e20ae231, ASSIGN}] 2023-10-06 04:01:36,945 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=105af8bdc86c6081580078f7e20ae231, ASSIGN 2023-10-06 04:01:36,945 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3f42b26e6f174cf9445a083febef25eb, ASSIGN 2023-10-06 04:01:36,946 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=105af8bdc86c6081580078f7e20ae231, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36359,1696564824167; forceNewPlan=false, retain=false 2023-10-06 04:01:36,946 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3f42b26e6f174cf9445a083febef25eb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38169,1696564824132; forceNewPlan=false, retain=false 2023-10-06 04:01:37,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-06 04:01:37,096 INFO [jenkins-hbase4:45627] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-06 04:01:37,099 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=3f42b26e6f174cf9445a083febef25eb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:37,099 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=105af8bdc86c6081580078f7e20ae231, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:37,099 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896901.3f42b26e6f174cf9445a083febef25eb.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696564897099"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696564897099"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696564897099"}]},"ts":"1696564897099"} 2023-10-06 04:01:37,099 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696564896901.105af8bdc86c6081580078f7e20ae231.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696564897099"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696564897099"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696564897099"}]},"ts":"1696564897099"} 2023-10-06 04:01:37,100 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 3f42b26e6f174cf9445a083febef25eb, server=jenkins-hbase4.apache.org,38169,1696564824132}] 2023-10-06 04:01:37,101 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 105af8bdc86c6081580078f7e20ae231, server=jenkins-hbase4.apache.org,36359,1696564824167}] 2023-10-06 04:01:37,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-06 04:01:37,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896901.3f42b26e6f174cf9445a083febef25eb. 2023-10-06 04:01:37,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3f42b26e6f174cf9445a083febef25eb, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896901.3f42b26e6f174cf9445a083febef25eb.', STARTKEY => '', ENDKEY => '2'} 2023-10-06 04:01:37,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1696564896901.105af8bdc86c6081580078f7e20ae231. 2023-10-06 04:01:37,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896901.3f42b26e6f174cf9445a083febef25eb. service=AccessControlService 2023-10-06 04:01:37,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 105af8bdc86c6081580078f7e20ae231, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696564896901.105af8bdc86c6081580078f7e20ae231.', STARTKEY => '2', ENDKEY => ''} 2023-10-06 04:01:37,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 04:01:37,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1696564896901.105af8bdc86c6081580078f7e20ae231. service=AccessControlService 2023-10-06 04:01:37,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 3f42b26e6f174cf9445a083febef25eb 2023-10-06 04:01:37,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896901.3f42b26e6f174cf9445a083febef25eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:01:37,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 04:01:37,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3f42b26e6f174cf9445a083febef25eb 2023-10-06 04:01:37,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3f42b26e6f174cf9445a083febef25eb 2023-10-06 04:01:37,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 105af8bdc86c6081580078f7e20ae231 2023-10-06 04:01:37,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696564896901.105af8bdc86c6081580078f7e20ae231.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:01:37,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 105af8bdc86c6081580078f7e20ae231 2023-10-06 04:01:37,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 105af8bdc86c6081580078f7e20ae231 2023-10-06 04:01:37,258 INFO [StoreOpener-3f42b26e6f174cf9445a083febef25eb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3f42b26e6f174cf9445a083febef25eb 2023-10-06 04:01:37,258 INFO [StoreOpener-105af8bdc86c6081580078f7e20ae231-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 105af8bdc86c6081580078f7e20ae231 2023-10-06 04:01:37,259 DEBUG [StoreOpener-3f42b26e6f174cf9445a083febef25eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3f42b26e6f174cf9445a083febef25eb/cf 2023-10-06 04:01:37,259 DEBUG [StoreOpener-105af8bdc86c6081580078f7e20ae231-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/105af8bdc86c6081580078f7e20ae231/cf 2023-10-06 04:01:37,259 DEBUG [StoreOpener-105af8bdc86c6081580078f7e20ae231-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/105af8bdc86c6081580078f7e20ae231/cf 2023-10-06 04:01:37,259 DEBUG [StoreOpener-3f42b26e6f174cf9445a083febef25eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3f42b26e6f174cf9445a083febef25eb/cf 2023-10-06 04:01:37,260 INFO [StoreOpener-105af8bdc86c6081580078f7e20ae231-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 105af8bdc86c6081580078f7e20ae231 columnFamilyName cf 2023-10-06 04:01:37,260 INFO [StoreOpener-3f42b26e6f174cf9445a083febef25eb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f42b26e6f174cf9445a083febef25eb columnFamilyName cf 2023-10-06 04:01:37,260 INFO [StoreOpener-105af8bdc86c6081580078f7e20ae231-1] regionserver.HStore(310): Store=105af8bdc86c6081580078f7e20ae231/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 04:01:37,260 INFO [StoreOpener-3f42b26e6f174cf9445a083febef25eb-1] regionserver.HStore(310): Store=3f42b26e6f174cf9445a083febef25eb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 04:01:37,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/105af8bdc86c6081580078f7e20ae231 2023-10-06 04:01:37,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3f42b26e6f174cf9445a083febef25eb 2023-10-06 04:01:37,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/105af8bdc86c6081580078f7e20ae231 2023-10-06 04:01:37,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3f42b26e6f174cf9445a083febef25eb 2023-10-06 04:01:37,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3f42b26e6f174cf9445a083febef25eb 2023-10-06 04:01:37,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 105af8bdc86c6081580078f7e20ae231 2023-10-06 04:01:37,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3f42b26e6f174cf9445a083febef25eb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 04:01:37,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/105af8bdc86c6081580078f7e20ae231/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 04:01:37,267 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3f42b26e6f174cf9445a083febef25eb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68154995, jitterRate=0.015588566660881042}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 04:01:37,267 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 105af8bdc86c6081580078f7e20ae231; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71262213, jitterRate=0.06188972294330597}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 04:01:37,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3f42b26e6f174cf9445a083febef25eb: 2023-10-06 04:01:37,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 105af8bdc86c6081580078f7e20ae231: 2023-10-06 04:01:37,267 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896901.3f42b26e6f174cf9445a083febef25eb., pid=69, masterSystemTime=1696564897252 2023-10-06 04:01:37,268 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696564896901.105af8bdc86c6081580078f7e20ae231., pid=70, masterSystemTime=1696564897253 2023-10-06 04:01:37,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896901.3f42b26e6f174cf9445a083febef25eb. 2023-10-06 04:01:37,269 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896901.3f42b26e6f174cf9445a083febef25eb. 2023-10-06 04:01:37,269 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=3f42b26e6f174cf9445a083febef25eb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:37,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696564896901.105af8bdc86c6081580078f7e20ae231. 2023-10-06 04:01:37,270 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896901.3f42b26e6f174cf9445a083febef25eb.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696564897269"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696564897269"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696564897269"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696564897269"}]},"ts":"1696564897269"} 2023-10-06 04:01:37,270 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1696564896901.105af8bdc86c6081580078f7e20ae231. 2023-10-06 04:01:37,270 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=105af8bdc86c6081580078f7e20ae231, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:37,270 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696564896901.105af8bdc86c6081580078f7e20ae231.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696564897270"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696564897270"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696564897270"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696564897270"}]},"ts":"1696564897270"} 2023-10-06 04:01:37,273 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-10-06 04:01:37,273 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 3f42b26e6f174cf9445a083febef25eb, server=jenkins-hbase4.apache.org,38169,1696564824132 in 171 msec 2023-10-06 04:01:37,274 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-10-06 04:01:37,274 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 105af8bdc86c6081580078f7e20ae231, server=jenkins-hbase4.apache.org,36359,1696564824167 in 171 msec 2023-10-06 04:01:37,275 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3f42b26e6f174cf9445a083febef25eb, ASSIGN in 331 msec 2023-10-06 04:01:37,276 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=66 2023-10-06 04:01:37,276 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=105af8bdc86c6081580078f7e20ae231, ASSIGN in 332 msec 2023-10-06 04:01:37,276 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-06 04:01:37,277 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696564897277"}]},"ts":"1696564897277"} 2023-10-06 04:01:37,278 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-10-06 04:01:37,280 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-10-06 04:01:37,280 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-10-06 04:01:37,282 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36351] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-06 04:01:37,284 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:01:37,284 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:01:37,284 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:01:37,284 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:01:37,286 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 04:01:37,286 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 04:01:37,286 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 04:01:37,286 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 04:01:37,286 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-06 04:01:37,286 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-06 04:01:37,286 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-06 04:01:37,286 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-06 04:01:37,287 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 383 msec 2023-10-06 04:01:37,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-06 04:01:37,509 INFO [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-10-06 04:01:37,529 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 3f42b26e6f174cf9445a083febef25eb, 105af8bdc86c6081580078f7e20ae231 2023-10-06 04:01:37,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[3f42b26e6f174cf9445a083febef25eb, 105af8bdc86c6081580078f7e20ae231], force=true 2023-10-06 04:01:37,539 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[3f42b26e6f174cf9445a083febef25eb, 105af8bdc86c6081580078f7e20ae231], force=true 2023-10-06 04:01:37,539 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[3f42b26e6f174cf9445a083febef25eb, 105af8bdc86c6081580078f7e20ae231], force=true 2023-10-06 04:01:37,539 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[3f42b26e6f174cf9445a083febef25eb, 105af8bdc86c6081580078f7e20ae231], force=true 2023-10-06 04:01:37,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-06 04:01:37,559 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3f42b26e6f174cf9445a083febef25eb, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=105af8bdc86c6081580078f7e20ae231, UNASSIGN}] 2023-10-06 04:01:37,561 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3f42b26e6f174cf9445a083febef25eb, UNASSIGN 2023-10-06 04:01:37,561 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=105af8bdc86c6081580078f7e20ae231, UNASSIGN 2023-10-06 04:01:37,562 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=3f42b26e6f174cf9445a083febef25eb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:37,562 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=105af8bdc86c6081580078f7e20ae231, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:37,562 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896901.3f42b26e6f174cf9445a083febef25eb.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696564897562"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696564897562"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696564897562"}]},"ts":"1696564897562"} 2023-10-06 04:01:37,562 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696564896901.105af8bdc86c6081580078f7e20ae231.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696564897562"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696564897562"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696564897562"}]},"ts":"1696564897562"} 2023-10-06 04:01:37,563 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 3f42b26e6f174cf9445a083febef25eb, server=jenkins-hbase4.apache.org,38169,1696564824132}] 2023-10-06 04:01:37,564 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 105af8bdc86c6081580078f7e20ae231, server=jenkins-hbase4.apache.org,36359,1696564824167}] 2023-10-06 04:01:37,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-06 04:01:37,716 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3f42b26e6f174cf9445a083febef25eb 2023-10-06 04:01:37,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3f42b26e6f174cf9445a083febef25eb, disabling compactions & flushes 2023-10-06 04:01:37,717 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896901.3f42b26e6f174cf9445a083febef25eb. 2023-10-06 04:01:37,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896901.3f42b26e6f174cf9445a083febef25eb. 2023-10-06 04:01:37,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896901.3f42b26e6f174cf9445a083febef25eb. after waiting 0 ms 2023-10-06 04:01:37,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896901.3f42b26e6f174cf9445a083febef25eb. 2023-10-06 04:01:37,717 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 3f42b26e6f174cf9445a083febef25eb 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-06 04:01:37,717 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 105af8bdc86c6081580078f7e20ae231 2023-10-06 04:01:37,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 105af8bdc86c6081580078f7e20ae231, disabling compactions & flushes 2023-10-06 04:01:37,718 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696564896901.105af8bdc86c6081580078f7e20ae231. 2023-10-06 04:01:37,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696564896901.105af8bdc86c6081580078f7e20ae231. 2023-10-06 04:01:37,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696564896901.105af8bdc86c6081580078f7e20ae231. after waiting 0 ms 2023-10-06 04:01:37,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696564896901.105af8bdc86c6081580078f7e20ae231. 2023-10-06 04:01:37,718 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 105af8bdc86c6081580078f7e20ae231 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-06 04:01:37,718 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-10-06 04:01:37,732 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/105af8bdc86c6081580078f7e20ae231/.tmp/cf/2ff265afc2fb4914a5acd9c59c8ef351 2023-10-06 04:01:37,732 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3f42b26e6f174cf9445a083febef25eb/.tmp/cf/c376c00875d4405ea84e51752f46e0e9 2023-10-06 04:01:37,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3f42b26e6f174cf9445a083febef25eb/.tmp/cf/c376c00875d4405ea84e51752f46e0e9 as hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3f42b26e6f174cf9445a083febef25eb/cf/c376c00875d4405ea84e51752f46e0e9 2023-10-06 04:01:37,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/105af8bdc86c6081580078f7e20ae231/.tmp/cf/2ff265afc2fb4914a5acd9c59c8ef351 as hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/105af8bdc86c6081580078f7e20ae231/cf/2ff265afc2fb4914a5acd9c59c8ef351 2023-10-06 04:01:37,743 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/105af8bdc86c6081580078f7e20ae231/cf/2ff265afc2fb4914a5acd9c59c8ef351, entries=1, sequenceid=5, filesize=4.7 K 2023-10-06 04:01:37,743 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3f42b26e6f174cf9445a083febef25eb/cf/c376c00875d4405ea84e51752f46e0e9, entries=1, sequenceid=5, filesize=4.7 K 2023-10-06 04:01:37,744 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 105af8bdc86c6081580078f7e20ae231 in 26ms, sequenceid=5, compaction requested=false 2023-10-06 04:01:37,744 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 3f42b26e6f174cf9445a083febef25eb in 27ms, sequenceid=5, compaction requested=false 2023-10-06 04:01:37,752 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3f42b26e6f174cf9445a083febef25eb/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-06 04:01:37,752 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/105af8bdc86c6081580078f7e20ae231/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-06 04:01:37,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 04:01:37,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896901.3f42b26e6f174cf9445a083febef25eb. 2023-10-06 04:01:37,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 04:01:37,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3f42b26e6f174cf9445a083febef25eb: 2023-10-06 04:01:37,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696564896901.105af8bdc86c6081580078f7e20ae231. 2023-10-06 04:01:37,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 105af8bdc86c6081580078f7e20ae231: 2023-10-06 04:01:37,755 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3f42b26e6f174cf9445a083febef25eb 2023-10-06 04:01:37,755 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=3f42b26e6f174cf9445a083febef25eb, regionState=CLOSED 2023-10-06 04:01:37,755 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 105af8bdc86c6081580078f7e20ae231 2023-10-06 04:01:37,755 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896901.3f42b26e6f174cf9445a083febef25eb.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696564897755"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696564897755"}]},"ts":"1696564897755"} 2023-10-06 04:01:37,755 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=105af8bdc86c6081580078f7e20ae231, regionState=CLOSED 2023-10-06 04:01:37,756 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696564896901.105af8bdc86c6081580078f7e20ae231.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696564897755"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696564897755"}]},"ts":"1696564897755"} 2023-10-06 04:01:37,758 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-10-06 04:01:37,758 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 3f42b26e6f174cf9445a083febef25eb, server=jenkins-hbase4.apache.org,38169,1696564824132 in 194 msec 2023-10-06 04:01:37,759 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-10-06 04:01:37,759 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 105af8bdc86c6081580078f7e20ae231, server=jenkins-hbase4.apache.org,36359,1696564824167 in 193 msec 2023-10-06 04:01:37,759 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3f42b26e6f174cf9445a083febef25eb, UNASSIGN in 201 msec 2023-10-06 04:01:37,760 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=71 2023-10-06 04:01:37,760 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=105af8bdc86c6081580078f7e20ae231, UNASSIGN in 200 msec 2023-10-06 04:01:37,804 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/12753a3a827816411d677d96bf846163/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-10-06 04:01:37,806 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896901.3f42b26e6f174cf9445a083febef25eb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-06 04:01:37,806 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696564896901.105af8bdc86c6081580078f7e20ae231.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-06 04:01:37,806 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896902.12753a3a827816411d677d96bf846163.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-06 04:01:37,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-06 04:01:37,852 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=12753a3a827816411d677d96bf846163, ASSIGN}] 2023-10-06 04:01:37,853 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=12753a3a827816411d677d96bf846163, ASSIGN 2023-10-06 04:01:37,854 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=12753a3a827816411d677d96bf846163, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,38169,1696564824132; forceNewPlan=false, retain=false 2023-10-06 04:01:38,004 INFO [jenkins-hbase4:45627] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-06 04:01:38,006 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=12753a3a827816411d677d96bf846163, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:38,006 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896902.12753a3a827816411d677d96bf846163.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696564898006"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696564898006"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696564898006"}]},"ts":"1696564898006"} 2023-10-06 04:01:38,008 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 12753a3a827816411d677d96bf846163, server=jenkins-hbase4.apache.org,38169,1696564824132}] 2023-10-06 04:01:38,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-06 04:01:38,162 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896902.12753a3a827816411d677d96bf846163. 2023-10-06 04:01:38,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 12753a3a827816411d677d96bf846163, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896902.12753a3a827816411d677d96bf846163.', STARTKEY => '', ENDKEY => ''} 2023-10-06 04:01:38,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896902.12753a3a827816411d677d96bf846163. service=AccessControlService 2023-10-06 04:01:38,163 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 04:01:38,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 12753a3a827816411d677d96bf846163 2023-10-06 04:01:38,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896902.12753a3a827816411d677d96bf846163.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:01:38,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 12753a3a827816411d677d96bf846163 2023-10-06 04:01:38,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 12753a3a827816411d677d96bf846163 2023-10-06 04:01:38,164 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/12753a3a827816411d677d96bf846163/.regioninfo 2023-10-06 04:01:38,172 INFO [StoreOpener-12753a3a827816411d677d96bf846163-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 12753a3a827816411d677d96bf846163 2023-10-06 04:01:38,173 DEBUG [StoreOpener-12753a3a827816411d677d96bf846163-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/12753a3a827816411d677d96bf846163/cf 2023-10-06 04:01:38,173 DEBUG [StoreOpener-12753a3a827816411d677d96bf846163-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/12753a3a827816411d677d96bf846163/cf 2023-10-06 04:01:38,173 INFO [StoreOpener-12753a3a827816411d677d96bf846163-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12753a3a827816411d677d96bf846163 columnFamilyName cf 2023-10-06 04:01:38,199 DEBUG [StoreOpener-12753a3a827816411d677d96bf846163-1] regionserver.HStore(539): loaded hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/12753a3a827816411d677d96bf846163/cf/2ff265afc2fb4914a5acd9c59c8ef351.105af8bdc86c6081580078f7e20ae231->hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/105af8bdc86c6081580078f7e20ae231/cf/2ff265afc2fb4914a5acd9c59c8ef351-top 2023-10-06 04:01:38,204 DEBUG [StoreOpener-12753a3a827816411d677d96bf846163-1] regionserver.HStore(539): loaded hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/12753a3a827816411d677d96bf846163/cf/c376c00875d4405ea84e51752f46e0e9.3f42b26e6f174cf9445a083febef25eb->hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3f42b26e6f174cf9445a083febef25eb/cf/c376c00875d4405ea84e51752f46e0e9-top 2023-10-06 04:01:38,205 INFO [StoreOpener-12753a3a827816411d677d96bf846163-1] regionserver.HStore(310): Store=12753a3a827816411d677d96bf846163/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 04:01:38,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/12753a3a827816411d677d96bf846163 2023-10-06 04:01:38,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/12753a3a827816411d677d96bf846163 2023-10-06 04:01:38,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 12753a3a827816411d677d96bf846163 2023-10-06 04:01:38,211 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 12753a3a827816411d677d96bf846163; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63158158, jitterRate=-0.0588701069355011}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 04:01:38,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 12753a3a827816411d677d96bf846163: 2023-10-06 04:01:38,212 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896902.12753a3a827816411d677d96bf846163., pid=77, masterSystemTime=1696564898159 2023-10-06 04:01:38,212 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896902.12753a3a827816411d677d96bf846163.,because compaction is disabled. 2023-10-06 04:01:38,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896902.12753a3a827816411d677d96bf846163. 2023-10-06 04:01:38,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896902.12753a3a827816411d677d96bf846163. 2023-10-06 04:01:38,214 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=12753a3a827816411d677d96bf846163, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:38,214 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896902.12753a3a827816411d677d96bf846163.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696564898214"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696564898214"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696564898214"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696564898214"}]},"ts":"1696564898214"} 2023-10-06 04:01:38,217 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-10-06 04:01:38,217 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 12753a3a827816411d677d96bf846163, server=jenkins-hbase4.apache.org,38169,1696564824132 in 208 msec 2023-10-06 04:01:38,219 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-10-06 04:01:38,219 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=12753a3a827816411d677d96bf846163, ASSIGN in 365 msec 2023-10-06 04:01:38,220 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[3f42b26e6f174cf9445a083febef25eb, 105af8bdc86c6081580078f7e20ae231], force=true in 687 msec 2023-10-06 04:01:38,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-06 04:01:38,645 INFO [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-10-06 04:01:38,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-06 04:01:38,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696564898646 (current time:1696564898646). 2023-10-06 04:01:38,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 04:01:38,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(139): Connect 0x7330e949 to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 04:01:38,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@690c9c3c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 04:01:38,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 04:01:38,656 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35660, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 04:01:38,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7330e949 to 127.0.0.1:57105 2023-10-06 04:01:38,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:01:38,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(139): Connect 0x78ff65f6 to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 04:01:38,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@cf1b101, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 04:01:38,664 DEBUG [hconnection-0x19121df-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 04:01:38,666 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35664, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 04:01:38,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x78ff65f6 to 127.0.0.1:57105 2023-10-06 04:01:38,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:01:38,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-06 04:01:38,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 04:01:38,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-06 04:01:38,674 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot, current working dir path: hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 04:01:38,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-06 04:01:38,676 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-06 04:01:38,677 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1696565498677 2023-10-06 04:01:38,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-06 04:01:38,677 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,680 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 04:01:38,680 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 04:01:38,681 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-06 04:01:38,681 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-06 04:01:38,682 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 6 msec 2023-10-06 04:01:38,683 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-06 04:01:38,683 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1696565498683 2023-10-06 04:01:38,691 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,691 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-10-06 04:01:38,691 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:01:38,692 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-10-06 04:01:38,692 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-10-06 04:01:38,693 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,693 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,694 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:38,694 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:38,694 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:38,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:38,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:38,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:38,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:38,694 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:38,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:38,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:38,695 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:38,695 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 04:01:38,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,695 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,695 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,696 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-06 04:01:38,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-06 04:01:38,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-06 04:01:38,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,696 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-06 04:01:38,696 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-06 04:01:38,696 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-06 04:01:38,696 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,696 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,696 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-06 04:01:38,696 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-06 04:01:38,696 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:01:38,696 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,697 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-06 04:01:38,697 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-06 04:01:38,697 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:01:38,696 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:01:38,698 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-06 04:01:38,699 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-06 04:01:38,699 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-06 04:01:38,697 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-06 04:01:38,699 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36359,1696564824167' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-06 04:01:38,699 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-06 04:01:38,699 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36351,1696564824083' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-06 04:01:38,699 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38169,1696564824132' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-06 04:01:38,701 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,701 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,701 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:38,701 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:38,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:01:38,701 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,701 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:01:38,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:01:38,701 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,701 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:01:38,701 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,701 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:01:38,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:01:38,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:01:38,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:38,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:38,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:38,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:01:38,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38169,1696564824132' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-10-06 04:01:38,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66fb0b3c[Count = 0] remaining members to acquire global barrier 2023-10-06 04:01:38,704 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-10-06 04:01:38,704 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,705 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,705 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,705 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,706 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-06 04:01:38,706 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:38,706 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 04:01:38,706 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 04:01:38,706 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 04:01:38,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,706 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896902.12753a3a827816411d677d96bf846163. 2023-10-06 04:01:38,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,706 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896902.12753a3a827816411d677d96bf846163. started... 2023-10-06 04:01:38,706 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-06 04:01:38,706 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-06 04:01:38,706 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,36351,1696564824083' in zk 2023-10-06 04:01:38,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,707 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-06 04:01:38,707 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 12753a3a827816411d677d96bf846163: 2023-10-06 04:01:38,707 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-06 04:01:38,707 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,36359,1696564824167' in zk 2023-10-06 04:01:38,707 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896902.12753a3a827816411d677d96bf846163.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,707 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 04:01:38,708 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/12753a3a827816411d677d96bf846163/cf/2ff265afc2fb4914a5acd9c59c8ef351.105af8bdc86c6081580078f7e20ae231->hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/105af8bdc86c6081580078f7e20ae231/cf/2ff265afc2fb4914a5acd9c59c8ef351-top, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/12753a3a827816411d677d96bf846163/cf/c376c00875d4405ea84e51752f46e0e9.3f42b26e6f174cf9445a083febef25eb->hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3f42b26e6f174cf9445a083febef25eb/cf/c376c00875d4405ea84e51752f46e0e9-top] hfiles 2023-10-06 04:01:38,708 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/12753a3a827816411d677d96bf846163/cf/2ff265afc2fb4914a5acd9c59c8ef351.105af8bdc86c6081580078f7e20ae231 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,708 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/12753a3a827816411d677d96bf846163/cf/c376c00875d4405ea84e51752f46e0e9.3f42b26e6f174cf9445a083febef25eb for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,709 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-06 04:01:38,709 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:01:38,709 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-06 04:01:38,710 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-06 04:01:38,710 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:01:38,710 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-06 04:01:38,723 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896902.12753a3a827816411d677d96bf846163. completed. 2023-10-06 04:01:38,723 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896902.12753a3a827816411d677d96bf846163. 2023-10-06 04:01:38,723 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 04:01:38,723 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 04:01:38,723 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:38,723 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-06 04:01:38,723 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,38169,1696564824132' in zk 2023-10-06 04:01:38,728 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:38,728 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-06 04:01:38,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:38,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:01:38,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:01:38,728 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:01:38,728 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-06 04:01:38,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:01:38,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:01:38,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:38,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:38,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:38,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:01:38,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:38,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:38,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:38,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,38169,1696564824132': 2023-10-06 04:01:38,731 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38169,1696564824132' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-10-06 04:01:38,731 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-10-06 04:01:38,731 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 04:01:38,731 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 04:01:38,731 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,731 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 04:01:38,733 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,733 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:01:38,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:01:38,733 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,733 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,734 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:38,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:01:38,734 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:38,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,734 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:38,733 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:38,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:38,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:38,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:38,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,734 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:38,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:38,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:01:38,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:38,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:38,735 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:38,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:38,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:38,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:38,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:01:38,738 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:38,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,739 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:38,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:38,739 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:38,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:38,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:38,742 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:38,742 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:38,742 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:38,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:38,742 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:01:38,742 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,742 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:38,742 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:38,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:38,742 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:38,742 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:38,742 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,742 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:38,742 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:38,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:38,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:38,742 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:38,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:38,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:38,742 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:38,743 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:38,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:38,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:38,743 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:38,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:38,743 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:38,743 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:38,743 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,743 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,764 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,764 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-10-06 04:01:38,764 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,765 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,765 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1696564898677Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696564898742 (+65 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696564898742Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696564898746 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696564898756 (+10 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1696564898764 (+8 ms) 2023-10-06 04:01:38,767 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-06 04:01:38,768 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 87 msec 2023-10-06 04:01:38,780 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 04:01:38,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-10-06 04:01:38,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 04:01:38,781 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564898781 2023-10-06 04:01:38,782 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42421, tgtDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564898781, rawTgtDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564898781, srcFsUri=hdfs://localhost:42421, srcDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91 2023-10-06 04:01:38,803 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42421, inputRoot=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91 2023-10-06 04:01:38,803 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-442380895_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564898781, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564898781/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,803 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42421, inputRoot=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91, snapshotDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-10-06 04:01:38,811 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564898781/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:38,830 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:38,831 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:38,832 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:38,832 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:38,833 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:38,833 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:38,833 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:38,904 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/hadoop-2205210906745854063.jar 2023-10-06 04:01:38,904 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:38,904 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:38,905 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:38,905 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:38,905 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:38,906 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:38,906 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-06 04:01:38,907 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-06 04:01:38,907 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-06 04:01:38,907 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-06 04:01:38,908 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-06 04:01:38,908 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-06 04:01:38,908 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-06 04:01:38,909 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-06 04:01:38,909 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-06 04:01:38,909 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-06 04:01:38,910 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 04:01:38,910 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 04:01:38,910 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 04:01:38,911 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 04:01:38,911 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 04:01:38,911 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 04:01:38,911 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 04:01:39,249 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696564830351_0004_000001 (auth:SIMPLE) 2023-10-06 04:01:39,261 WARN [Listener at jenkins-hbase4.apache.org/34869] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-06 04:01:39,263 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-10-06 04:01:39,265 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-10-06 04:01:39,317 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 04:01:39,317 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 04:01:40,065 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696564830351_0005_000001 (auth:SIMPLE) 2023-10-06 04:01:40,816 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-06 04:01:43,732 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696564830351_0005_000001 (auth:SIMPLE) 2023-10-06 04:01:45,939 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696564830351_0005_000001 (auth:SIMPLE) 2023-10-06 04:01:48,260 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696564830351_0005_000001 (auth:SIMPLE) 2023-10-06 04:01:49,414 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-06 04:01:49,417 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-06 04:01:49,426 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:49,426 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-06 04:01:49,426 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-06 04:01:49,426 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1023520784_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:49,427 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(367): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-06 04:01:49,427 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(367): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-06 04:01:49,427 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1023520784_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564898781/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564898781/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:49,427 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(367): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564898781/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-06 04:01:49,427 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(367): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564898781/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-06 04:01:49,433 INFO [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:49,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:49,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:49,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-06 04:01:49,437 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696564909437"}]},"ts":"1696564909437"} 2023-10-06 04:01:49,439 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-10-06 04:01:49,441 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-10-06 04:01:49,441 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=12753a3a827816411d677d96bf846163, UNASSIGN}] 2023-10-06 04:01:49,443 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=12753a3a827816411d677d96bf846163, UNASSIGN 2023-10-06 04:01:49,444 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=12753a3a827816411d677d96bf846163, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:49,444 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896902.12753a3a827816411d677d96bf846163.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696564909444"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696564909444"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696564909444"}]},"ts":"1696564909444"} 2023-10-06 04:01:49,445 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 12753a3a827816411d677d96bf846163, server=jenkins-hbase4.apache.org,38169,1696564824132}] 2023-10-06 04:01:49,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-06 04:01:49,596 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 12753a3a827816411d677d96bf846163 2023-10-06 04:01:49,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 12753a3a827816411d677d96bf846163, disabling compactions & flushes 2023-10-06 04:01:49,596 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896902.12753a3a827816411d677d96bf846163. 2023-10-06 04:01:49,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896902.12753a3a827816411d677d96bf846163. 2023-10-06 04:01:49,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896902.12753a3a827816411d677d96bf846163. after waiting 0 ms 2023-10-06 04:01:49,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896902.12753a3a827816411d677d96bf846163. 2023-10-06 04:01:49,607 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/12753a3a827816411d677d96bf846163/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-10-06 04:01:49,607 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 04:01:49,608 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896902.12753a3a827816411d677d96bf846163. 2023-10-06 04:01:49,608 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 12753a3a827816411d677d96bf846163: 2023-10-06 04:01:49,609 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 12753a3a827816411d677d96bf846163 2023-10-06 04:01:49,610 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=12753a3a827816411d677d96bf846163, regionState=CLOSED 2023-10-06 04:01:49,610 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896902.12753a3a827816411d677d96bf846163.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696564909609"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696564909609"}]},"ts":"1696564909609"} 2023-10-06 04:01:49,613 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-10-06 04:01:49,613 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 12753a3a827816411d677d96bf846163, server=jenkins-hbase4.apache.org,38169,1696564824132 in 166 msec 2023-10-06 04:01:49,614 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-10-06 04:01:49,614 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=12753a3a827816411d677d96bf846163, UNASSIGN in 172 msec 2023-10-06 04:01:49,615 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696564909615"}]},"ts":"1696564909615"} 2023-10-06 04:01:49,616 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-10-06 04:01:49,618 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-10-06 04:01:49,619 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 186 msec 2023-10-06 04:01:49,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-06 04:01:49,739 INFO [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-10-06 04:01:49,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:49,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:49,743 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:49,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:49,743 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:49,745 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36351] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:49,748 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/105af8bdc86c6081580078f7e20ae231 2023-10-06 04:01:49,748 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3f42b26e6f174cf9445a083febef25eb 2023-10-06 04:01:49,748 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/12753a3a827816411d677d96bf846163 2023-10-06 04:01:49,749 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:49,749 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:49,749 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:49,749 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:49,749 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-06 04:01:49,750 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-06 04:01:49,750 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-06 04:01:49,750 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-06 04:01:49,750 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/105af8bdc86c6081580078f7e20ae231/cf, FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/105af8bdc86c6081580078f7e20ae231/recovered.edits] 2023-10-06 04:01:49,751 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/12753a3a827816411d677d96bf846163/cf, FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/12753a3a827816411d677d96bf846163/recovered.edits] 2023-10-06 04:01:49,751 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:49,751 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:01:49,751 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:49,751 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:49,751 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:01:49,751 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3f42b26e6f174cf9445a083febef25eb/cf, FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3f42b26e6f174cf9445a083febef25eb/recovered.edits] 2023-10-06 04:01:49,751 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:49,751 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:01:49,752 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:01:49,752 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 04:01:49,752 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 04:01:49,752 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 04:01:49,753 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 04:01:49,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-06 04:01:49,757 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/105af8bdc86c6081580078f7e20ae231/cf/2ff265afc2fb4914a5acd9c59c8ef351 to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/105af8bdc86c6081580078f7e20ae231/cf/2ff265afc2fb4914a5acd9c59c8ef351 2023-10-06 04:01:49,757 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/12753a3a827816411d677d96bf846163/cf/2ff265afc2fb4914a5acd9c59c8ef351.105af8bdc86c6081580078f7e20ae231 to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/12753a3a827816411d677d96bf846163/cf/2ff265afc2fb4914a5acd9c59c8ef351.105af8bdc86c6081580078f7e20ae231 2023-10-06 04:01:49,757 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3f42b26e6f174cf9445a083febef25eb/cf/c376c00875d4405ea84e51752f46e0e9 to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3f42b26e6f174cf9445a083febef25eb/cf/c376c00875d4405ea84e51752f46e0e9 2023-10-06 04:01:49,760 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/12753a3a827816411d677d96bf846163/cf/c376c00875d4405ea84e51752f46e0e9.3f42b26e6f174cf9445a083febef25eb to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/12753a3a827816411d677d96bf846163/cf/c376c00875d4405ea84e51752f46e0e9.3f42b26e6f174cf9445a083febef25eb 2023-10-06 04:01:49,762 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/105af8bdc86c6081580078f7e20ae231/recovered.edits/8.seqid to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/105af8bdc86c6081580078f7e20ae231/recovered.edits/8.seqid 2023-10-06 04:01:49,762 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/105af8bdc86c6081580078f7e20ae231 2023-10-06 04:01:49,763 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3f42b26e6f174cf9445a083febef25eb/recovered.edits/8.seqid to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3f42b26e6f174cf9445a083febef25eb/recovered.edits/8.seqid 2023-10-06 04:01:49,763 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3f42b26e6f174cf9445a083febef25eb 2023-10-06 04:01:49,764 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/12753a3a827816411d677d96bf846163/recovered.edits/12.seqid to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/12753a3a827816411d677d96bf846163/recovered.edits/12.seqid 2023-10-06 04:01:49,765 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/12753a3a827816411d677d96bf846163 2023-10-06 04:01:49,765 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-06 04:01:49,767 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:49,769 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-10-06 04:01:49,771 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-10-06 04:01:49,776 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:49,776 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-10-06 04:01:49,776 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896902.12753a3a827816411d677d96bf846163.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696564909776"}]},"ts":"9223372036854775807"} 2023-10-06 04:01:49,777 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-10-06 04:01:49,777 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 12753a3a827816411d677d96bf846163, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696564896902.12753a3a827816411d677d96bf846163.', STARTKEY => '', ENDKEY => ''}] 2023-10-06 04:01:49,778 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-10-06 04:01:49,778 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696564909778"}]},"ts":"9223372036854775807"} 2023-10-06 04:01:49,782 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-10-06 04:01:49,784 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:49,785 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 44 msec 2023-10-06 04:01:49,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-06 04:01:49,854 INFO [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-10-06 04:01:49,855 INFO [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:49,855 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:49,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:49,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-06 04:01:49,859 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696564909859"}]},"ts":"1696564909859"} 2023-10-06 04:01:49,860 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-10-06 04:01:49,862 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-10-06 04:01:49,863 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5a5c6a411d7f75f638a87bfbed44d9d9, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6f1de060f8661341540e36a0da57c77f, UNASSIGN}] 2023-10-06 04:01:49,864 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5a5c6a411d7f75f638a87bfbed44d9d9, UNASSIGN 2023-10-06 04:01:49,864 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6f1de060f8661341540e36a0da57c77f, UNASSIGN 2023-10-06 04:01:49,865 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=5a5c6a411d7f75f638a87bfbed44d9d9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:49,865 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=6f1de060f8661341540e36a0da57c77f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:49,865 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696564909865"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696564909865"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696564909865"}]},"ts":"1696564909865"} 2023-10-06 04:01:49,865 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696564909865"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696564909865"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696564909865"}]},"ts":"1696564909865"} 2023-10-06 04:01:49,867 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 5a5c6a411d7f75f638a87bfbed44d9d9, server=jenkins-hbase4.apache.org,36351,1696564824083}] 2023-10-06 04:01:49,867 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 6f1de060f8661341540e36a0da57c77f, server=jenkins-hbase4.apache.org,38169,1696564824132}] 2023-10-06 04:01:49,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-06 04:01:50,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5a5c6a411d7f75f638a87bfbed44d9d9 2023-10-06 04:01:50,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5a5c6a411d7f75f638a87bfbed44d9d9, disabling compactions & flushes 2023-10-06 04:01:50,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9. 2023-10-06 04:01:50,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9. 2023-10-06 04:01:50,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9. after waiting 0 ms 2023-10-06 04:01:50,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9. 2023-10-06 04:01:50,023 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6f1de060f8661341540e36a0da57c77f 2023-10-06 04:01:50,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6f1de060f8661341540e36a0da57c77f, disabling compactions & flushes 2023-10-06 04:01:50,023 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f. 2023-10-06 04:01:50,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f. 2023-10-06 04:01:50,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f. after waiting 0 ms 2023-10-06 04:01:50,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f. 2023-10-06 04:01:50,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion/5a5c6a411d7f75f638a87bfbed44d9d9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 04:01:50,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f1de060f8661341540e36a0da57c77f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 04:01:50,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 04:01:50,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 04:01:50,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9. 2023-10-06 04:01:50,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5a5c6a411d7f75f638a87bfbed44d9d9: 2023-10-06 04:01:50,032 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f. 2023-10-06 04:01:50,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6f1de060f8661341540e36a0da57c77f: 2023-10-06 04:01:50,033 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5a5c6a411d7f75f638a87bfbed44d9d9 2023-10-06 04:01:50,034 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=5a5c6a411d7f75f638a87bfbed44d9d9, regionState=CLOSED 2023-10-06 04:01:50,034 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696564910034"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696564910034"}]},"ts":"1696564910034"} 2023-10-06 04:01:50,034 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6f1de060f8661341540e36a0da57c77f 2023-10-06 04:01:50,035 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=6f1de060f8661341540e36a0da57c77f, regionState=CLOSED 2023-10-06 04:01:50,035 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696564910035"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696564910035"}]},"ts":"1696564910035"} 2023-10-06 04:01:50,038 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-10-06 04:01:50,038 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-10-06 04:01:50,038 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 5a5c6a411d7f75f638a87bfbed44d9d9, server=jenkins-hbase4.apache.org,36351,1696564824083 in 168 msec 2023-10-06 04:01:50,038 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 6f1de060f8661341540e36a0da57c77f, server=jenkins-hbase4.apache.org,38169,1696564824132 in 169 msec 2023-10-06 04:01:50,039 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6f1de060f8661341540e36a0da57c77f, UNASSIGN in 175 msec 2023-10-06 04:01:50,039 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=84 2023-10-06 04:01:50,039 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5a5c6a411d7f75f638a87bfbed44d9d9, UNASSIGN in 176 msec 2023-10-06 04:01:50,040 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696564910040"}]},"ts":"1696564910040"} 2023-10-06 04:01:50,041 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-10-06 04:01:50,043 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-10-06 04:01:50,044 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 188 msec 2023-10-06 04:01:50,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-06 04:01:50,161 INFO [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-10-06 04:01:50,162 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:50,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:50,164 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:50,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:50,165 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:50,166 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36351] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:50,169 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:50,169 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:50,169 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:50,169 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:50,169 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5a5c6a411d7f75f638a87bfbed44d9d9 2023-10-06 04:01:50,169 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f1de060f8661341540e36a0da57c77f 2023-10-06 04:01:50,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-06 04:01:50,170 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-06 04:01:50,170 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-06 04:01:50,170 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-06 04:01:50,171 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:50,171 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:50,171 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:01:50,171 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:50,171 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:50,171 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:01:50,171 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f1de060f8661341540e36a0da57c77f/cf, FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f1de060f8661341540e36a0da57c77f/recovered.edits] 2023-10-06 04:01:50,171 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:01:50,171 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:01:50,172 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5a5c6a411d7f75f638a87bfbed44d9d9/cf, FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5a5c6a411d7f75f638a87bfbed44d9d9/recovered.edits] 2023-10-06 04:01:50,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-06 04:01:50,176 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f1de060f8661341540e36a0da57c77f/cf/8a26f8575ee645609e0c37c964ef1a62 to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f1de060f8661341540e36a0da57c77f/cf/8a26f8575ee645609e0c37c964ef1a62 2023-10-06 04:01:50,176 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5a5c6a411d7f75f638a87bfbed44d9d9/cf/1514f15c45e3407cafe3779a473ab8b3 to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/5a5c6a411d7f75f638a87bfbed44d9d9/cf/1514f15c45e3407cafe3779a473ab8b3 2023-10-06 04:01:50,179 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f1de060f8661341540e36a0da57c77f/recovered.edits/9.seqid to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f1de060f8661341540e36a0da57c77f/recovered.edits/9.seqid 2023-10-06 04:01:50,179 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5a5c6a411d7f75f638a87bfbed44d9d9/recovered.edits/9.seqid to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/5a5c6a411d7f75f638a87bfbed44d9d9/recovered.edits/9.seqid 2023-10-06 04:01:50,179 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f1de060f8661341540e36a0da57c77f 2023-10-06 04:01:50,180 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5a5c6a411d7f75f638a87bfbed44d9d9 2023-10-06 04:01:50,180 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-06 04:01:50,180 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-06 04:01:50,181 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-10-06 04:01:50,183 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231006da9e0e8e8d224765baa3dc3feeedc830 to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231006da9e0e8e8d224765baa3dc3feeedc830 2023-10-06 04:01:50,185 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231006afbe25bc5b2342af908e4c557ba7b67b to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231006afbe25bc5b2342af908e4c557ba7b67b 2023-10-06 04:01:50,185 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-06 04:01:50,187 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:50,189 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-10-06 04:01:50,190 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-10-06 04:01:50,191 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:50,191 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-10-06 04:01:50,191 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696564910191"}]},"ts":"9223372036854775807"} 2023-10-06 04:01:50,191 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696564910191"}]},"ts":"9223372036854775807"} 2023-10-06 04:01:50,193 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-06 04:01:50,193 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5a5c6a411d7f75f638a87bfbed44d9d9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696564895540.5a5c6a411d7f75f638a87bfbed44d9d9.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6f1de060f8661341540e36a0da57c77f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696564895540.6f1de060f8661341540e36a0da57c77f.', STARTKEY => '1', ENDKEY => ''}] 2023-10-06 04:01:50,193 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-10-06 04:01:50,193 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696564910193"}]},"ts":"9223372036854775807"} 2023-10-06 04:01:50,194 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-10-06 04:01:50,196 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:50,197 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 34 msec 2023-10-06 04:01:50,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-06 04:01:50,273 INFO [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-10-06 04:01:50,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-06 04:01:50,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:50,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-06 04:01:50,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 04:01:50,288 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-10-06 04:01:50,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 04:01:50,312 INFO [Listener at jenkins-hbase4.apache.org/34869] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759 (was 747) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1562387764_1 at /127.0.0.1:57118 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1023520784_17 at /127.0.0.1:52096 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x76348612-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x76348612-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1023520784_17 at /127.0.0.1:32976 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x76348612-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3950 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1023520784_17 at /127.0.0.1:57144 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (32912118) connection to jenkins-hbase4.apache.org/172.31.14.131:32791 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1562387764_1 at /127.0.0.1:52072 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x76348612-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x76348612-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x76348612-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=912 (was 902) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=188 (was 241), ProcessCount=168 (was 168), AvailableMemoryMB=5773 (was 5817) 2023-10-06 04:01:50,312 WARN [Listener at jenkins-hbase4.apache.org/34869] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-10-06 04:01:50,330 INFO [Listener at jenkins-hbase4.apache.org/34869] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=759, OpenFileDescriptor=912, MaxFileDescriptor=60000, SystemLoadAverage=188, ProcessCount=168, AvailableMemoryMB=5772 2023-10-06 04:01:50,330 WARN [Listener at jenkins-hbase4.apache.org/34869] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-10-06 04:01:50,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-06 04:01:50,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-06 04:01:50,334 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-06 04:01:50,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-10-06 04:01:50,335 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-06 04:01:50,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-06 04:01:50,337 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testEmptyExportFileSystemState/81a17e3cb0c1a9b2263a9b7d46f0cc57 2023-10-06 04:01:50,337 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testEmptyExportFileSystemState/a59e250ebf521ed7ee84e18667d7a1cc 2023-10-06 04:01:50,337 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testEmptyExportFileSystemState/81a17e3cb0c1a9b2263a9b7d46f0cc57 empty. 2023-10-06 04:01:50,337 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testEmptyExportFileSystemState/a59e250ebf521ed7ee84e18667d7a1cc empty. 2023-10-06 04:01:50,338 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testEmptyExportFileSystemState/81a17e3cb0c1a9b2263a9b7d46f0cc57 2023-10-06 04:01:50,338 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testEmptyExportFileSystemState/a59e250ebf521ed7ee84e18667d7a1cc 2023-10-06 04:01:50,338 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-06 04:01:50,346 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-06 04:01:50,347 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 81a17e3cb0c1a9b2263a9b7d46f0cc57, NAME => 'testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp 2023-10-06 04:01:50,348 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => a59e250ebf521ed7ee84e18667d7a1cc, NAME => 'testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp 2023-10-06 04:01:50,357 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:01:50,357 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 81a17e3cb0c1a9b2263a9b7d46f0cc57, disabling compactions & flushes 2023-10-06 04:01:50,357 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57. 2023-10-06 04:01:50,357 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57. 2023-10-06 04:01:50,357 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57. after waiting 0 ms 2023-10-06 04:01:50,357 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57. 2023-10-06 04:01:50,357 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57. 2023-10-06 04:01:50,357 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 81a17e3cb0c1a9b2263a9b7d46f0cc57: 2023-10-06 04:01:50,357 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:01:50,357 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing a59e250ebf521ed7ee84e18667d7a1cc, disabling compactions & flushes 2023-10-06 04:01:50,357 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc. 2023-10-06 04:01:50,357 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc. 2023-10-06 04:01:50,358 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc. after waiting 0 ms 2023-10-06 04:01:50,358 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc. 2023-10-06 04:01:50,358 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc. 2023-10-06 04:01:50,358 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for a59e250ebf521ed7ee84e18667d7a1cc: 2023-10-06 04:01:50,359 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-06 04:01:50,360 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696564910360"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696564910360"}]},"ts":"1696564910360"} 2023-10-06 04:01:50,360 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696564910360"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696564910360"}]},"ts":"1696564910360"} 2023-10-06 04:01:50,362 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-06 04:01:50,362 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-06 04:01:50,363 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696564910363"}]},"ts":"1696564910363"} 2023-10-06 04:01:50,364 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-10-06 04:01:50,366 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-06 04:01:50,367 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-06 04:01:50,367 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-06 04:01:50,367 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-06 04:01:50,367 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-06 04:01:50,368 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=81a17e3cb0c1a9b2263a9b7d46f0cc57, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a59e250ebf521ed7ee84e18667d7a1cc, ASSIGN}] 2023-10-06 04:01:50,370 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a59e250ebf521ed7ee84e18667d7a1cc, ASSIGN 2023-10-06 04:01:50,370 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=81a17e3cb0c1a9b2263a9b7d46f0cc57, ASSIGN 2023-10-06 04:01:50,370 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a59e250ebf521ed7ee84e18667d7a1cc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36351,1696564824083; forceNewPlan=false, retain=false 2023-10-06 04:01:50,371 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=81a17e3cb0c1a9b2263a9b7d46f0cc57, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38169,1696564824132; forceNewPlan=false, retain=false 2023-10-06 04:01:50,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-06 04:01:50,521 INFO [jenkins-hbase4:45627] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-06 04:01:50,523 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=81a17e3cb0c1a9b2263a9b7d46f0cc57, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:50,523 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=a59e250ebf521ed7ee84e18667d7a1cc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:50,523 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696564910523"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696564910523"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696564910523"}]},"ts":"1696564910523"} 2023-10-06 04:01:50,524 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696564910523"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696564910523"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696564910523"}]},"ts":"1696564910523"} 2023-10-06 04:01:50,525 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 81a17e3cb0c1a9b2263a9b7d46f0cc57, server=jenkins-hbase4.apache.org,38169,1696564824132}] 2023-10-06 04:01:50,526 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure a59e250ebf521ed7ee84e18667d7a1cc, server=jenkins-hbase4.apache.org,36351,1696564824083}] 2023-10-06 04:01:50,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-06 04:01:50,679 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57. 2023-10-06 04:01:50,679 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc. 2023-10-06 04:01:50,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 81a17e3cb0c1a9b2263a9b7d46f0cc57, NAME => 'testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57.', STARTKEY => '', ENDKEY => '1'} 2023-10-06 04:01:50,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a59e250ebf521ed7ee84e18667d7a1cc, NAME => 'testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc.', STARTKEY => '1', ENDKEY => ''} 2023-10-06 04:01:50,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57. service=AccessControlService 2023-10-06 04:01:50,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc. service=AccessControlService 2023-10-06 04:01:50,680 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 04:01:50,680 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 04:01:50,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 81a17e3cb0c1a9b2263a9b7d46f0cc57 2023-10-06 04:01:50,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState a59e250ebf521ed7ee84e18667d7a1cc 2023-10-06 04:01:50,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:01:50,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:01:50,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 81a17e3cb0c1a9b2263a9b7d46f0cc57 2023-10-06 04:01:50,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a59e250ebf521ed7ee84e18667d7a1cc 2023-10-06 04:01:50,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 81a17e3cb0c1a9b2263a9b7d46f0cc57 2023-10-06 04:01:50,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a59e250ebf521ed7ee84e18667d7a1cc 2023-10-06 04:01:50,681 INFO [StoreOpener-a59e250ebf521ed7ee84e18667d7a1cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a59e250ebf521ed7ee84e18667d7a1cc 2023-10-06 04:01:50,682 INFO [StoreOpener-81a17e3cb0c1a9b2263a9b7d46f0cc57-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 81a17e3cb0c1a9b2263a9b7d46f0cc57 2023-10-06 04:01:50,683 DEBUG [StoreOpener-81a17e3cb0c1a9b2263a9b7d46f0cc57-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testEmptyExportFileSystemState/81a17e3cb0c1a9b2263a9b7d46f0cc57/cf 2023-10-06 04:01:50,683 DEBUG [StoreOpener-81a17e3cb0c1a9b2263a9b7d46f0cc57-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testEmptyExportFileSystemState/81a17e3cb0c1a9b2263a9b7d46f0cc57/cf 2023-10-06 04:01:50,683 DEBUG [StoreOpener-a59e250ebf521ed7ee84e18667d7a1cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testEmptyExportFileSystemState/a59e250ebf521ed7ee84e18667d7a1cc/cf 2023-10-06 04:01:50,683 DEBUG [StoreOpener-a59e250ebf521ed7ee84e18667d7a1cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testEmptyExportFileSystemState/a59e250ebf521ed7ee84e18667d7a1cc/cf 2023-10-06 04:01:50,683 INFO [StoreOpener-81a17e3cb0c1a9b2263a9b7d46f0cc57-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81a17e3cb0c1a9b2263a9b7d46f0cc57 columnFamilyName cf 2023-10-06 04:01:50,683 INFO [StoreOpener-a59e250ebf521ed7ee84e18667d7a1cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a59e250ebf521ed7ee84e18667d7a1cc columnFamilyName cf 2023-10-06 04:01:50,684 INFO [StoreOpener-a59e250ebf521ed7ee84e18667d7a1cc-1] regionserver.HStore(310): Store=a59e250ebf521ed7ee84e18667d7a1cc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 04:01:50,684 INFO [StoreOpener-81a17e3cb0c1a9b2263a9b7d46f0cc57-1] regionserver.HStore(310): Store=81a17e3cb0c1a9b2263a9b7d46f0cc57/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 04:01:50,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testEmptyExportFileSystemState/a59e250ebf521ed7ee84e18667d7a1cc 2023-10-06 04:01:50,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testEmptyExportFileSystemState/81a17e3cb0c1a9b2263a9b7d46f0cc57 2023-10-06 04:01:50,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testEmptyExportFileSystemState/a59e250ebf521ed7ee84e18667d7a1cc 2023-10-06 04:01:50,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testEmptyExportFileSystemState/81a17e3cb0c1a9b2263a9b7d46f0cc57 2023-10-06 04:01:50,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 81a17e3cb0c1a9b2263a9b7d46f0cc57 2023-10-06 04:01:50,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a59e250ebf521ed7ee84e18667d7a1cc 2023-10-06 04:01:50,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testEmptyExportFileSystemState/81a17e3cb0c1a9b2263a9b7d46f0cc57/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 04:01:50,690 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 81a17e3cb0c1a9b2263a9b7d46f0cc57; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59626397, jitterRate=-0.11149744689464569}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 04:01:50,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 81a17e3cb0c1a9b2263a9b7d46f0cc57: 2023-10-06 04:01:50,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testEmptyExportFileSystemState/a59e250ebf521ed7ee84e18667d7a1cc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 04:01:50,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57., pid=93, masterSystemTime=1696564910677 2023-10-06 04:01:50,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a59e250ebf521ed7ee84e18667d7a1cc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68458099, jitterRate=0.020105168223381042}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 04:01:50,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a59e250ebf521ed7ee84e18667d7a1cc: 2023-10-06 04:01:50,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc., pid=94, masterSystemTime=1696564910677 2023-10-06 04:01:50,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57. 2023-10-06 04:01:50,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57. 2023-10-06 04:01:50,693 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=81a17e3cb0c1a9b2263a9b7d46f0cc57, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:50,693 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696564910693"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696564910693"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696564910693"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696564910693"}]},"ts":"1696564910693"} 2023-10-06 04:01:50,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc. 2023-10-06 04:01:50,693 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc. 2023-10-06 04:01:50,694 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=a59e250ebf521ed7ee84e18667d7a1cc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:50,694 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696564910693"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696564910693"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696564910693"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696564910693"}]},"ts":"1696564910693"} 2023-10-06 04:01:50,696 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-10-06 04:01:50,696 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 81a17e3cb0c1a9b2263a9b7d46f0cc57, server=jenkins-hbase4.apache.org,38169,1696564824132 in 169 msec 2023-10-06 04:01:50,696 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=92 2023-10-06 04:01:50,696 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure a59e250ebf521ed7ee84e18667d7a1cc, server=jenkins-hbase4.apache.org,36351,1696564824083 in 169 msec 2023-10-06 04:01:50,697 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=81a17e3cb0c1a9b2263a9b7d46f0cc57, ASSIGN in 328 msec 2023-10-06 04:01:50,698 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-10-06 04:01:50,698 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a59e250ebf521ed7ee84e18667d7a1cc, ASSIGN in 328 msec 2023-10-06 04:01:50,698 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-06 04:01:50,698 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696564910698"}]},"ts":"1696564910698"} 2023-10-06 04:01:50,699 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-10-06 04:01:50,701 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-06 04:01:50,702 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-10-06 04:01:50,703 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36351] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-06 04:01:50,706 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:01:50,706 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:01:50,706 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:01:50,706 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:01:50,707 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-06 04:01:50,707 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-06 04:01:50,707 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-06 04:01:50,707 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-06 04:01:50,708 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 375 msec 2023-10-06 04:01:50,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-06 04:01:50,939 INFO [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-10-06 04:01:50,941 DEBUG [Listener at jenkins-hbase4.apache.org/34869] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-06 04:01:50,941 DEBUG [Listener at jenkins-hbase4.apache.org/34869] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57. 2023-10-06 04:01:50,944 INFO [Listener at jenkins-hbase4.apache.org/34869] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 04:01:50,954 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 04:01:50,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696564910954 (current time:1696564910954). 2023-10-06 04:01:50,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 04:01:50,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(139): Connect 0x1edb943e to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 04:01:50,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6190c387, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 04:01:50,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 04:01:50,967 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48354, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 04:01:50,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1edb943e to 127.0.0.1:57105 2023-10-06 04:01:50,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:01:50,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(139): Connect 0x7d83f62a to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 04:01:50,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f3bf7c0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 04:01:50,976 DEBUG [hconnection-0x5850875b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 04:01:50,977 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48366, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 04:01:50,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d83f62a to 127.0.0.1:57105 2023-10-06 04:01:50,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:01:50,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-06 04:01:50,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 04:01:50,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 04:01:50,984 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot, current working dir path: hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 04:01:50,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-06 04:01:50,989 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-06 04:01:50,990 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696565510990 2023-10-06 04:01:50,990 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-06 04:01:50,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 04:01:50,991 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 04:01:50,991 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 04:01:50,992 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-06 04:01:50,992 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-06 04:01:50,992 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-10-06 04:01:50,995 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-06 04:01:50,996 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696565510996 2023-10-06 04:01:51,003 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,003 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-10-06 04:01:51,004 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:01:51,004 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-06 04:01:51,004 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-06 04:01:51,005 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,005 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,012 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:51,012 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:51,012 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:51,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:51,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:51,012 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:51,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:51,012 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:51,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:51,012 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,013 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,013 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 04:01:51,013 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,013 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,013 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-06 04:01:51,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-06 04:01:51,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,013 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-06 04:01:51,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-06 04:01:51,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,013 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-06 04:01:51,013 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,013 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-06 04:01:51,014 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-06 04:01:51,014 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:01:51,015 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-06 04:01:51,015 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,015 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-06 04:01:51,015 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-06 04:01:51,015 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:01:51,015 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38169,1696564824132' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-06 04:01:51,015 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,016 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-06 04:01:51,016 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-06 04:01:51,016 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:01:51,016 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-06 04:01:51,017 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-06 04:01:51,017 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-06 04:01:51,017 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36359,1696564824167' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-06 04:01:51,017 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36351,1696564824083' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-06 04:01:51,018 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,018 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:01:51,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:01:51,018 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,018 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:01:51,019 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,019 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,020 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,020 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:01:51,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:01:51,020 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:01:51,021 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,021 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:01:51,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:51,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:01:51,022 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38169,1696564824132' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-06 04:01:51,022 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55f7fc7f[Count = 1] remaining members to acquire global barrier 2023-10-06 04:01:51,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:01:51,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:01:51,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:01:51,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:01:51,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:51,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:01:51,025 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36351,1696564824083' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-06 04:01:51,025 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55f7fc7f[Count = 0] remaining members to acquire global barrier 2023-10-06 04:01:51,025 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-06 04:01:51,025 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,027 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,027 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,027 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,027 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,027 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-06 04:01:51,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,028 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,028 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 04:01:51,028 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-06 04:01:51,028 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57. 2023-10-06 04:01:51,028 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 04:01:51,028 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 04:01:51,028 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-06 04:01:51,028 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57. started... 2023-10-06 04:01:51,028 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-06 04:01:51,028 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36359,1696564824167' in zk 2023-10-06 04:01:51,028 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 04:01:51,028 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 81a17e3cb0c1a9b2263a9b7d46f0cc57: 2023-10-06 04:01:51,028 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc. 2023-10-06 04:01:51,028 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 04:01:51,028 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,028 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc. started... 2023-10-06 04:01:51,028 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 04:01:51,028 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 04:01:51,029 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a59e250ebf521ed7ee84e18667d7a1cc: 2023-10-06 04:01:51,030 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,030 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 04:01:51,030 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 04:01:51,030 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-06 04:01:51,031 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:01:51,031 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-06 04:01:51,038 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc. completed. 2023-10-06 04:01:51,038 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc. 2023-10-06 04:01:51,038 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 04:01:51,039 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 04:01:51,039 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57. completed. 2023-10-06 04:01:51,039 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57. 2023-10-06 04:01:51,039 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,039 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 04:01:51,039 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 04:01:51,039 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,039 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-06 04:01:51,039 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36351,1696564824083' in zk 2023-10-06 04:01:51,039 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-06 04:01:51,039 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38169,1696564824132' in zk 2023-10-06 04:01:51,040 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-06 04:01:51,040 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-06 04:01:51,040 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:01:51,040 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,041 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-06 04:01:51,042 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:01:51,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:01:51,041 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:01:51,042 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-06 04:01:51,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:01:51,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:01:51,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:51,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:01:51,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:51,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,36351,1696564824083': 2023-10-06 04:01:51,046 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36351,1696564824083' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-06 04:01:51,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:01:51,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:01:51,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:01:51,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:01:51,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:51,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:01:51,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:51,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,38169,1696564824132': 2023-10-06 04:01:51,048 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38169,1696564824132' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-06 04:01:51,048 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-10-06 04:01:51,049 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 04:01:51,049 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 04:01:51,049 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,049 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 04:01:51,050 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,050 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,050 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:51,050 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,050 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,051 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:51,051 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:51,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:01:51,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:01:51,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:51,051 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:51,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:01:51,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:51,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:51,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:51,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:51,051 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,052 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:51,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:01:51,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:51,053 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:01:51,054 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,054 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:51,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:51,057 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:51,057 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,057 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:51,057 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,057 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:51,057 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,057 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:51,057 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:51,057 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-06 04:01:51,057 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:51,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:51,057 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:51,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:51,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:51,057 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:51,057 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:01:51,057 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:51,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:51,057 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:51,059 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 04:01:51,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:51,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:51,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:51,058 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:51,059 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:51,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:51,059 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,059 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,059 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,059 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,059 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-06 04:01:51,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,068 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,090 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,091 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-06 04:01:51,091 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,091 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 04:01:51,091 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,091 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696564910990Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696564911067 (+77 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696564911067Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1696564911067Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1696564911072 (+5 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696564911085 (+13 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696564911091 (+6 ms) 2023-10-06 04:01:51,094 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-06 04:01:51,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-06 04:01:51,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 04:01:51,096 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 104 msec 2023-10-06 04:01:51,097 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38169] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 04:01:51,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36351] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 04:01:51,101 DEBUG [Listener at jenkins-hbase4.apache.org/34869] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-06 04:01:51,101 DEBUG [Listener at jenkins-hbase4.apache.org/34869] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57. 2023-10-06 04:01:51,101 INFO [Listener at jenkins-hbase4.apache.org/34869] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 04:01:51,110 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 04:01:51,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696564911110 (current time:1696564911110). 2023-10-06 04:01:51,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 04:01:51,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(139): Connect 0x6b0babd4 to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 04:01:51,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c533a80, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 04:01:51,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 04:01:51,121 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48372, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 04:01:51,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b0babd4 to 127.0.0.1:57105 2023-10-06 04:01:51,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:01:51,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(139): Connect 0x51a6d42f to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 04:01:51,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67c580c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 04:01:51,130 DEBUG [hconnection-0x42673186-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 04:01:51,133 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48384, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 04:01:51,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51a6d42f to 127.0.0.1:57105 2023-10-06 04:01:51,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:01:51,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-06 04:01:51,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 04:01:51,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 04:01:51,142 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot, current working dir path: hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 04:01:51,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-06 04:01:51,144 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-06 04:01:51,144 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696565511144 2023-10-06 04:01:51,144 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-06 04:01:51,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 04:01:51,146 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 04:01:51,146 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 04:01:51,147 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-06 04:01:51,148 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-06 04:01:51,148 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-10-06 04:01:51,149 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-06 04:01:51,150 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696565511150 2023-10-06 04:01:51,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,162 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-10-06 04:01:51,162 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:01:51,163 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-06 04:01:51,163 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-06 04:01:51,164 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,164 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,165 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:51,165 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:51,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:51,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:51,165 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:51,165 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:51,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:51,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:51,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:51,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,166 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,166 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,166 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,166 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,166 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 04:01:51,166 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,166 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-06 04:01:51,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-06 04:01:51,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-06 04:01:51,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,167 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-06 04:01:51,167 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-06 04:01:51,167 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-06 04:01:51,167 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,167 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,167 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,167 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-06 04:01:51,167 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-06 04:01:51,167 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:01:51,167 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-06 04:01:51,167 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:01:51,169 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-06 04:01:51,170 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-06 04:01:51,170 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-06 04:01:51,170 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36359,1696564824167' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-06 04:01:51,167 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:01:51,170 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-06 04:01:51,170 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38169,1696564824132' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-06 04:01:51,173 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-06 04:01:51,173 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-06 04:01:51,174 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36351,1696564824083' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-06 04:01:51,176 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,176 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,176 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:01:51,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:01:51,176 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:01:51,177 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,177 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,176 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,177 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:01:51,177 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:01:51,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:01:51,177 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,177 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:01:51,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:51,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:01:51,179 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38169,1696564824132' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-06 04:01:51,179 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@317ab8fe[Count = 1] remaining members to acquire global barrier 2023-10-06 04:01:51,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:01:51,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:01:51,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:01:51,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:01:51,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:51,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:01:51,181 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36351,1696564824083' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-06 04:01:51,181 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@317ab8fe[Count = 0] remaining members to acquire global barrier 2023-10-06 04:01:51,181 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-06 04:01:51,181 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,185 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,185 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,185 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,185 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-06 04:01:51,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,185 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,185 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-06 04:01:51,185 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-06 04:01:51,185 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-06 04:01:51,185 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57. 2023-10-06 04:01:51,185 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36359,1696564824167' in zk 2023-10-06 04:01:51,186 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 04:01:51,186 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,186 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc. 2023-10-06 04:01:51,185 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 04:01:51,186 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 04:01:51,186 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc. started... 2023-10-06 04:01:51,186 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 04:01:51,186 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 04:01:51,185 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57. started... 2023-10-06 04:01:51,186 INFO [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a59e250ebf521ed7ee84e18667d7a1cc 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-10-06 04:01:51,186 INFO [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 81a17e3cb0c1a9b2263a9b7d46f0cc57 1/1 column families, dataSize=199 B heapSize=688 B 2023-10-06 04:01:51,187 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-06 04:01:51,187 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:01:51,187 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-06 04:01:51,211 INFO [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310066500e2e28dad45b6b6488619eeffd25e to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310066500e2e28dad45b6b6488619eeffd25e 2023-10-06 04:01:51,211 INFO [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231006a4857650908940eda246ce64f198e764 to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231006a4857650908940eda246ce64f198e764 2023-10-06 04:01:51,219 INFO [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testEmptyExportFileSystemState/81a17e3cb0c1a9b2263a9b7d46f0cc57/.tmp/cf/6674ac83b5f847f1bb3e2312a0161d60 2023-10-06 04:01:51,219 INFO [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testEmptyExportFileSystemState/a59e250ebf521ed7ee84e18667d7a1cc/.tmp/cf/c91413ab4f724983bd57350e81582501 2023-10-06 04:01:51,225 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testEmptyExportFileSystemState/a59e250ebf521ed7ee84e18667d7a1cc/.tmp/cf/c91413ab4f724983bd57350e81582501 as hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testEmptyExportFileSystemState/a59e250ebf521ed7ee84e18667d7a1cc/cf/c91413ab4f724983bd57350e81582501 2023-10-06 04:01:51,225 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testEmptyExportFileSystemState/81a17e3cb0c1a9b2263a9b7d46f0cc57/.tmp/cf/6674ac83b5f847f1bb3e2312a0161d60 as hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testEmptyExportFileSystemState/81a17e3cb0c1a9b2263a9b7d46f0cc57/cf/6674ac83b5f847f1bb3e2312a0161d60 2023-10-06 04:01:51,230 INFO [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testEmptyExportFileSystemState/81a17e3cb0c1a9b2263a9b7d46f0cc57/cf/6674ac83b5f847f1bb3e2312a0161d60, entries=3, sequenceid=6, filesize=5.4 K 2023-10-06 04:01:51,230 INFO [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testEmptyExportFileSystemState/a59e250ebf521ed7ee84e18667d7a1cc/cf/c91413ab4f724983bd57350e81582501, entries=47, sequenceid=6, filesize=13.1 K 2023-10-06 04:01:51,231 INFO [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 81a17e3cb0c1a9b2263a9b7d46f0cc57 in 45ms, sequenceid=6, compaction requested=false 2023-10-06 04:01:51,231 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-10-06 04:01:51,231 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 81a17e3cb0c1a9b2263a9b7d46f0cc57: 2023-10-06 04:01:51,231 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,231 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 04:01:51,231 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testEmptyExportFileSystemState/81a17e3cb0c1a9b2263a9b7d46f0cc57/cf/6674ac83b5f847f1bb3e2312a0161d60] hfiles 2023-10-06 04:01:51,231 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testEmptyExportFileSystemState/81a17e3cb0c1a9b2263a9b7d46f0cc57/cf/6674ac83b5f847f1bb3e2312a0161d60 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,234 INFO [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for a59e250ebf521ed7ee84e18667d7a1cc in 48ms, sequenceid=6, compaction requested=false 2023-10-06 04:01:51,235 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a59e250ebf521ed7ee84e18667d7a1cc: 2023-10-06 04:01:51,235 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,236 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 04:01:51,236 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testEmptyExportFileSystemState/a59e250ebf521ed7ee84e18667d7a1cc/cf/c91413ab4f724983bd57350e81582501] hfiles 2023-10-06 04:01:51,236 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testEmptyExportFileSystemState/a59e250ebf521ed7ee84e18667d7a1cc/cf/c91413ab4f724983bd57350e81582501 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,240 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57. completed. 2023-10-06 04:01:51,241 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57. 2023-10-06 04:01:51,241 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 04:01:51,241 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 04:01:51,241 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,241 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-06 04:01:51,241 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38169,1696564824132' in zk 2023-10-06 04:01:51,243 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc. completed. 2023-10-06 04:01:51,244 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc. 2023-10-06 04:01:51,244 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 04:01:51,244 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 04:01:51,244 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,244 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-06 04:01:51,244 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36351,1696564824083' in zk 2023-10-06 04:01:51,245 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,245 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-06 04:01:51,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:01:51,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:01:51,245 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:01:51,245 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-06 04:01:51,246 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 04:01:51,246 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,246 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-06 04:01:51,247 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:01:51,247 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-06 04:01:51,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:01:51,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:01:51,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-06 04:01:51,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-06 04:01:51,249 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 04:01:51,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:51,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:01:51,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:51,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,38169,1696564824132': 2023-10-06 04:01:51,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38169,1696564824132' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-06 04:01:51,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:01:51,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:01:51,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:01:51,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:01:51,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:51,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:01:51,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:51,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,36351,1696564824083': 2023-10-06 04:01:51,254 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36351,1696564824083' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-06 04:01:51,254 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-10-06 04:01:51,254 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 04:01:51,254 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 04:01:51,254 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,254 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 04:01:51,257 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,257 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:01:51,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:01:51,257 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,257 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,257 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:51,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,257 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:51,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,257 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:51,258 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:01:51,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:51,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:51,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:51,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:51,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:51,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:51,258 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,259 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:51,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:01:51,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:51,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:01:51,260 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,260 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,260 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:51,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:51,263 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:51,263 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,263 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:51,263 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,263 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:51,263 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:51,263 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,263 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:01:51,263 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:01:51,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:51,263 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:51,263 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,263 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:01:51,263 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:51,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:01:51,263 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:51,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:51,264 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-06 04:01:51,263 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:01:51,265 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:01:51,263 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:01:51,265 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 04:01:51,265 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:01:51,265 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,265 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:51,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:51,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:51,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:51,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:01:51,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:01:51,266 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310066500e2e28dad45b6b6488619eeffd25e, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231006a4857650908940eda246ce64f198e764] mob files 2023-10-06 04:01:51,266 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310066500e2e28dad45b6b6488619eeffd25e 2023-10-06 04:01:51,266 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231006a4857650908940eda246ce64f198e764 2023-10-06 04:01:51,272 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,273 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,294 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,295 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-06 04:01:51,295 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,295 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,295 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696564911145Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696564911272 (+127 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1696564911272Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1696564911273 (+1 ms)Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1696564911277 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1696564911288 (+11 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696564911295 (+7 ms) 2023-10-06 04:01:51,300 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-06 04:01:51,301 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 154 msec 2023-10-06 04:01:51,449 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 04:01:51,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-06 04:01:51,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 04:01:51,450 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564911450 2023-10-06 04:01:51,450 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42421, tgtDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564911450, rawTgtDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564911450, srcFsUri=hdfs://localhost:42421, srcDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91 2023-10-06 04:01:51,472 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42421, inputRoot=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91 2023-10-06 04:01:51,472 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1996890302_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564911450, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564911450/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,472 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42421, inputRoot=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91, snapshotDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-10-06 04:01:51,477 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564911450/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:01:51,496 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:51,496 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:51,496 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:51,496 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:51,497 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:51,497 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:51,497 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:51,564 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/hadoop-4212410949416977906.jar 2023-10-06 04:01:51,564 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:51,565 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:51,565 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:51,565 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:51,566 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:51,566 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-06 04:01:51,566 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-06 04:01:51,566 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-06 04:01:51,567 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-06 04:01:51,567 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-06 04:01:51,567 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-06 04:01:51,568 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-06 04:01:51,568 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-06 04:01:51,568 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-06 04:01:51,569 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-06 04:01:51,569 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-06 04:01:51,570 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 04:01:51,570 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 04:01:51,570 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 04:01:51,570 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 04:01:51,571 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 04:01:51,571 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 04:01:51,571 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 04:01:51,915 WARN [Listener at jenkins-hbase4.apache.org/34869] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-06 04:01:51,917 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-10-06 04:01:54,439 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 04:01:54,440 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 04:01:54,443 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696564830351_0005_000001 (auth:SIMPLE) 2023-10-06 04:01:55,228 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-06 04:01:55,260 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696564830351_0006_000001 (auth:SIMPLE) 2023-10-06 04:01:58,811 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696564830351_0006_000001 (auth:SIMPLE) 2023-10-06 04:02:01,251 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-06 04:02:01,252 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-06 04:02:01,257 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:02:01,258 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-06 04:02:01,258 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-06 04:02:01,258 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1023520784_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:02:01,259 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(367): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-06 04:02:01,259 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(367): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-06 04:02:01,259 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1023520784_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564911450/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564911450/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:02:01,259 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(367): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564911450/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-06 04:02:01,259 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(367): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564911450/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-06 04:02:01,264 INFO [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-10-06 04:02:01,264 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-10-06 04:02:01,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-06 04:02:01,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-06 04:02:01,268 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696564921268"}]},"ts":"1696564921268"} 2023-10-06 04:02:01,269 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-10-06 04:02:01,271 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-10-06 04:02:01,271 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=81a17e3cb0c1a9b2263a9b7d46f0cc57, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a59e250ebf521ed7ee84e18667d7a1cc, UNASSIGN}] 2023-10-06 04:02:01,273 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=81a17e3cb0c1a9b2263a9b7d46f0cc57, UNASSIGN 2023-10-06 04:02:01,273 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a59e250ebf521ed7ee84e18667d7a1cc, UNASSIGN 2023-10-06 04:02:01,274 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=81a17e3cb0c1a9b2263a9b7d46f0cc57, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:01,274 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=a59e250ebf521ed7ee84e18667d7a1cc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:01,274 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696564921274"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696564921274"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696564921274"}]},"ts":"1696564921274"} 2023-10-06 04:02:01,274 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696564921274"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696564921274"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696564921274"}]},"ts":"1696564921274"} 2023-10-06 04:02:01,275 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 81a17e3cb0c1a9b2263a9b7d46f0cc57, server=jenkins-hbase4.apache.org,38169,1696564824132}] 2023-10-06 04:02:01,276 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure a59e250ebf521ed7ee84e18667d7a1cc, server=jenkins-hbase4.apache.org,36351,1696564824083}] 2023-10-06 04:02:01,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-06 04:02:01,427 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 81a17e3cb0c1a9b2263a9b7d46f0cc57 2023-10-06 04:02:01,427 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a59e250ebf521ed7ee84e18667d7a1cc 2023-10-06 04:02:01,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 81a17e3cb0c1a9b2263a9b7d46f0cc57, disabling compactions & flushes 2023-10-06 04:02:01,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a59e250ebf521ed7ee84e18667d7a1cc, disabling compactions & flushes 2023-10-06 04:02:01,427 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57. 2023-10-06 04:02:01,427 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc. 2023-10-06 04:02:01,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc. 2023-10-06 04:02:01,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57. 2023-10-06 04:02:01,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc. after waiting 0 ms 2023-10-06 04:02:01,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc. 2023-10-06 04:02:01,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57. after waiting 0 ms 2023-10-06 04:02:01,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57. 2023-10-06 04:02:01,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testEmptyExportFileSystemState/81a17e3cb0c1a9b2263a9b7d46f0cc57/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 04:02:01,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testEmptyExportFileSystemState/a59e250ebf521ed7ee84e18667d7a1cc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 04:02:01,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 04:02:01,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 04:02:01,438 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57. 2023-10-06 04:02:01,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc. 2023-10-06 04:02:01,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 81a17e3cb0c1a9b2263a9b7d46f0cc57: 2023-10-06 04:02:01,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a59e250ebf521ed7ee84e18667d7a1cc: 2023-10-06 04:02:01,440 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 81a17e3cb0c1a9b2263a9b7d46f0cc57 2023-10-06 04:02:01,441 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=81a17e3cb0c1a9b2263a9b7d46f0cc57, regionState=CLOSED 2023-10-06 04:02:01,441 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696564921440"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696564921440"}]},"ts":"1696564921440"} 2023-10-06 04:02:01,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a59e250ebf521ed7ee84e18667d7a1cc 2023-10-06 04:02:01,441 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=a59e250ebf521ed7ee84e18667d7a1cc, regionState=CLOSED 2023-10-06 04:02:01,441 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696564921441"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696564921441"}]},"ts":"1696564921441"} 2023-10-06 04:02:01,443 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-10-06 04:02:01,443 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 81a17e3cb0c1a9b2263a9b7d46f0cc57, server=jenkins-hbase4.apache.org,38169,1696564824132 in 167 msec 2023-10-06 04:02:01,444 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-10-06 04:02:01,444 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure a59e250ebf521ed7ee84e18667d7a1cc, server=jenkins-hbase4.apache.org,36351,1696564824083 in 167 msec 2023-10-06 04:02:01,444 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=81a17e3cb0c1a9b2263a9b7d46f0cc57, UNASSIGN in 172 msec 2023-10-06 04:02:01,445 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-10-06 04:02:01,445 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a59e250ebf521ed7ee84e18667d7a1cc, UNASSIGN in 173 msec 2023-10-06 04:02:01,446 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696564921446"}]},"ts":"1696564921446"} 2023-10-06 04:02:01,447 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-10-06 04:02:01,449 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-10-06 04:02:01,450 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 186 msec 2023-10-06 04:02:01,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-06 04:02:01,570 INFO [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-10-06 04:02:01,571 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-10-06 04:02:01,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-06 04:02:01,574 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-06 04:02:01,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-10-06 04:02:01,574 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-06 04:02:01,576 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36351] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-10-06 04:02:01,578 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testEmptyExportFileSystemState/81a17e3cb0c1a9b2263a9b7d46f0cc57 2023-10-06 04:02:01,578 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testEmptyExportFileSystemState/a59e250ebf521ed7ee84e18667d7a1cc 2023-10-06 04:02:01,580 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testEmptyExportFileSystemState/81a17e3cb0c1a9b2263a9b7d46f0cc57/cf, FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testEmptyExportFileSystemState/81a17e3cb0c1a9b2263a9b7d46f0cc57/recovered.edits] 2023-10-06 04:02:01,580 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-06 04:02:01,580 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-06 04:02:01,580 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-06 04:02:01,580 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-06 04:02:01,580 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testEmptyExportFileSystemState/a59e250ebf521ed7ee84e18667d7a1cc/cf, FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testEmptyExportFileSystemState/a59e250ebf521ed7ee84e18667d7a1cc/recovered.edits] 2023-10-06 04:02:01,580 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-06 04:02:01,580 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-06 04:02:01,580 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-06 04:02:01,580 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-06 04:02:01,584 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testEmptyExportFileSystemState/81a17e3cb0c1a9b2263a9b7d46f0cc57/cf/6674ac83b5f847f1bb3e2312a0161d60 to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testEmptyExportFileSystemState/81a17e3cb0c1a9b2263a9b7d46f0cc57/cf/6674ac83b5f847f1bb3e2312a0161d60 2023-10-06 04:02:01,584 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testEmptyExportFileSystemState/a59e250ebf521ed7ee84e18667d7a1cc/cf/c91413ab4f724983bd57350e81582501 to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testEmptyExportFileSystemState/a59e250ebf521ed7ee84e18667d7a1cc/cf/c91413ab4f724983bd57350e81582501 2023-10-06 04:02:01,586 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-06 04:02:01,586 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-06 04:02:01,586 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:02:01,586 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-06 04:02:01,586 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-06 04:02:01,586 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:02:01,586 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:02:01,586 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:02:01,587 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testEmptyExportFileSystemState/81a17e3cb0c1a9b2263a9b7d46f0cc57/recovered.edits/9.seqid to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testEmptyExportFileSystemState/81a17e3cb0c1a9b2263a9b7d46f0cc57/recovered.edits/9.seqid 2023-10-06 04:02:01,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-06 04:02:01,588 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testEmptyExportFileSystemState/a59e250ebf521ed7ee84e18667d7a1cc/recovered.edits/9.seqid to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testEmptyExportFileSystemState/a59e250ebf521ed7ee84e18667d7a1cc/recovered.edits/9.seqid 2023-10-06 04:02:01,588 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testEmptyExportFileSystemState/81a17e3cb0c1a9b2263a9b7d46f0cc57 2023-10-06 04:02:01,588 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testEmptyExportFileSystemState/a59e250ebf521ed7ee84e18667d7a1cc 2023-10-06 04:02:01,588 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-06 04:02:01,589 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-06 04:02:01,589 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-10-06 04:02:01,592 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310066500e2e28dad45b6b6488619eeffd25e to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310066500e2e28dad45b6b6488619eeffd25e 2023-10-06 04:02:01,594 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231006a4857650908940eda246ce64f198e764 to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231006a4857650908940eda246ce64f198e764 2023-10-06 04:02:01,594 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-06 04:02:01,596 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-06 04:02:01,598 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-10-06 04:02:01,599 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-10-06 04:02:01,600 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-06 04:02:01,600 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-10-06 04:02:01,600 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696564921600"}]},"ts":"9223372036854775807"} 2023-10-06 04:02:01,600 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696564921600"}]},"ts":"9223372036854775807"} 2023-10-06 04:02:01,602 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-06 04:02:01,602 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 81a17e3cb0c1a9b2263a9b7d46f0cc57, NAME => 'testtb-testEmptyExportFileSystemState,,1696564910331.81a17e3cb0c1a9b2263a9b7d46f0cc57.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a59e250ebf521ed7ee84e18667d7a1cc, NAME => 'testtb-testEmptyExportFileSystemState,1,1696564910331.a59e250ebf521ed7ee84e18667d7a1cc.', STARTKEY => '1', ENDKEY => ''}] 2023-10-06 04:02:01,602 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-10-06 04:02:01,602 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696564921602"}]},"ts":"9223372036854775807"} 2023-10-06 04:02:01,603 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-10-06 04:02:01,605 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-06 04:02:01,606 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 34 msec 2023-10-06 04:02:01,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-06 04:02:01,689 INFO [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-10-06 04:02:01,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-10-06 04:02:01,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 04:02:01,699 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-10-06 04:02:01,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-10-06 04:02:01,726 INFO [Listener at jenkins-hbase4.apache.org/34869] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 759) Potentially hanging thread: hconnection-0x76348612-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1023520784_17 at /127.0.0.1:56528 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (32912118) connection to jenkins-hbase4.apache.org/172.31.14.131:37403 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x76348612-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x76348612-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x76348612-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (32912118) connection to jenkins-hbase4.apache.org/172.31.14.131:42843 from appattempt_1696564830351_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-4606 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (32912118) connection to jenkins-hbase4.apache.org/172.31.14.131:33801 from appattempt_1696564830351_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1023520784_17 at /127.0.0.1:58142 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1738897695_1 at /127.0.0.1:59678 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1738897695_1 at /127.0.0.1:56504 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1023520784_17 at /127.0.0.1:59706 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=925 (was 912) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=159 (was 188), ProcessCount=168 (was 168), AvailableMemoryMB=5735 (was 5772) 2023-10-06 04:02:01,726 WARN [Listener at jenkins-hbase4.apache.org/34869] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-06 04:02:01,746 INFO [Listener at jenkins-hbase4.apache.org/34869] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=925, MaxFileDescriptor=60000, SystemLoadAverage=159, ProcessCount=168, AvailableMemoryMB=5734 2023-10-06 04:02:01,746 WARN [Listener at jenkins-hbase4.apache.org/34869] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-06 04:02:01,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-06 04:02:01,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:01,751 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-10-06 04:02:01,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-10-06 04:02:01,751 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-06 04:02:01,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-06 04:02:01,754 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/334eb676fe1f660a1cc60fc3b98c07c5 2023-10-06 04:02:01,754 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc1ecc85442c5fd7cf1c49d5ea9f36f7 2023-10-06 04:02:01,754 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/334eb676fe1f660a1cc60fc3b98c07c5 empty. 2023-10-06 04:02:01,754 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc1ecc85442c5fd7cf1c49d5ea9f36f7 empty. 2023-10-06 04:02:01,754 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/334eb676fe1f660a1cc60fc3b98c07c5 2023-10-06 04:02:01,755 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc1ecc85442c5fd7cf1c49d5ea9f36f7 2023-10-06 04:02:01,755 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-06 04:02:01,768 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-10-06 04:02:01,769 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 334eb676fe1f660a1cc60fc3b98c07c5, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp 2023-10-06 04:02:01,769 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => fc1ecc85442c5fd7cf1c49d5ea9f36f7, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp 2023-10-06 04:02:01,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:02:01,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:02:01,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing fc1ecc85442c5fd7cf1c49d5ea9f36f7, disabling compactions & flushes 2023-10-06 04:02:01,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 334eb676fe1f660a1cc60fc3b98c07c5, disabling compactions & flushes 2023-10-06 04:02:01,784 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7. 2023-10-06 04:02:01,784 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5. 2023-10-06 04:02:01,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5. 2023-10-06 04:02:01,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7. 2023-10-06 04:02:01,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5. after waiting 0 ms 2023-10-06 04:02:01,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7. after waiting 0 ms 2023-10-06 04:02:01,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5. 2023-10-06 04:02:01,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7. 2023-10-06 04:02:01,784 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5. 2023-10-06 04:02:01,784 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7. 2023-10-06 04:02:01,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 334eb676fe1f660a1cc60fc3b98c07c5: 2023-10-06 04:02:01,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for fc1ecc85442c5fd7cf1c49d5ea9f36f7: 2023-10-06 04:02:01,787 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-10-06 04:02:01,788 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696564921787"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696564921787"}]},"ts":"1696564921787"} 2023-10-06 04:02:01,788 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696564921787"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696564921787"}]},"ts":"1696564921787"} 2023-10-06 04:02:01,790 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-06 04:02:01,790 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-06 04:02:01,790 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696564921790"}]},"ts":"1696564921790"} 2023-10-06 04:02:01,791 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-10-06 04:02:01,795 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-06 04:02:01,796 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-06 04:02:01,796 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-06 04:02:01,796 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-06 04:02:01,796 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-06 04:02:01,796 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=334eb676fe1f660a1cc60fc3b98c07c5, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fc1ecc85442c5fd7cf1c49d5ea9f36f7, ASSIGN}] 2023-10-06 04:02:01,799 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fc1ecc85442c5fd7cf1c49d5ea9f36f7, ASSIGN 2023-10-06 04:02:01,799 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=334eb676fe1f660a1cc60fc3b98c07c5, ASSIGN 2023-10-06 04:02:01,799 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fc1ecc85442c5fd7cf1c49d5ea9f36f7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36351,1696564824083; forceNewPlan=false, retain=false 2023-10-06 04:02:01,799 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=334eb676fe1f660a1cc60fc3b98c07c5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38169,1696564824132; forceNewPlan=false, retain=false 2023-10-06 04:02:01,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-06 04:02:01,950 INFO [jenkins-hbase4:45627] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-06 04:02:01,952 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=334eb676fe1f660a1cc60fc3b98c07c5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:01,952 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=fc1ecc85442c5fd7cf1c49d5ea9f36f7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:01,953 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696564921952"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696564921952"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696564921952"}]},"ts":"1696564921952"} 2023-10-06 04:02:01,953 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696564921952"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696564921952"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696564921952"}]},"ts":"1696564921952"} 2023-10-06 04:02:01,954 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 334eb676fe1f660a1cc60fc3b98c07c5, server=jenkins-hbase4.apache.org,38169,1696564824132}] 2023-10-06 04:02:01,955 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure fc1ecc85442c5fd7cf1c49d5ea9f36f7, server=jenkins-hbase4.apache.org,36351,1696564824083}] 2023-10-06 04:02:02,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-06 04:02:02,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5. 2023-10-06 04:02:02,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7. 2023-10-06 04:02:02,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 334eb676fe1f660a1cc60fc3b98c07c5, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5.', STARTKEY => '', ENDKEY => '1'} 2023-10-06 04:02:02,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fc1ecc85442c5fd7cf1c49d5ea9f36f7, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7.', STARTKEY => '1', ENDKEY => ''} 2023-10-06 04:02:02,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5. service=AccessControlService 2023-10-06 04:02:02,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7. service=AccessControlService 2023-10-06 04:02:02,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 04:02:02,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 04:02:02,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp fc1ecc85442c5fd7cf1c49d5ea9f36f7 2023-10-06 04:02:02,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:02:02,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 334eb676fe1f660a1cc60fc3b98c07c5 2023-10-06 04:02:02,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fc1ecc85442c5fd7cf1c49d5ea9f36f7 2023-10-06 04:02:02,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 04:02:02,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fc1ecc85442c5fd7cf1c49d5ea9f36f7 2023-10-06 04:02:02,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 334eb676fe1f660a1cc60fc3b98c07c5 2023-10-06 04:02:02,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 334eb676fe1f660a1cc60fc3b98c07c5 2023-10-06 04:02:02,111 INFO [StoreOpener-fc1ecc85442c5fd7cf1c49d5ea9f36f7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fc1ecc85442c5fd7cf1c49d5ea9f36f7 2023-10-06 04:02:02,111 INFO [StoreOpener-334eb676fe1f660a1cc60fc3b98c07c5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 334eb676fe1f660a1cc60fc3b98c07c5 2023-10-06 04:02:02,113 DEBUG [StoreOpener-fc1ecc85442c5fd7cf1c49d5ea9f36f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc1ecc85442c5fd7cf1c49d5ea9f36f7/cf 2023-10-06 04:02:02,113 DEBUG [StoreOpener-334eb676fe1f660a1cc60fc3b98c07c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithSkipTmp/334eb676fe1f660a1cc60fc3b98c07c5/cf 2023-10-06 04:02:02,113 DEBUG [StoreOpener-334eb676fe1f660a1cc60fc3b98c07c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithSkipTmp/334eb676fe1f660a1cc60fc3b98c07c5/cf 2023-10-06 04:02:02,113 DEBUG [StoreOpener-fc1ecc85442c5fd7cf1c49d5ea9f36f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc1ecc85442c5fd7cf1c49d5ea9f36f7/cf 2023-10-06 04:02:02,113 INFO [StoreOpener-fc1ecc85442c5fd7cf1c49d5ea9f36f7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc1ecc85442c5fd7cf1c49d5ea9f36f7 columnFamilyName cf 2023-10-06 04:02:02,113 INFO [StoreOpener-334eb676fe1f660a1cc60fc3b98c07c5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 334eb676fe1f660a1cc60fc3b98c07c5 columnFamilyName cf 2023-10-06 04:02:02,115 INFO [StoreOpener-334eb676fe1f660a1cc60fc3b98c07c5-1] regionserver.HStore(310): Store=334eb676fe1f660a1cc60fc3b98c07c5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 04:02:02,115 INFO [StoreOpener-fc1ecc85442c5fd7cf1c49d5ea9f36f7-1] regionserver.HStore(310): Store=fc1ecc85442c5fd7cf1c49d5ea9f36f7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 04:02:02,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithSkipTmp/334eb676fe1f660a1cc60fc3b98c07c5 2023-10-06 04:02:02,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc1ecc85442c5fd7cf1c49d5ea9f36f7 2023-10-06 04:02:02,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithSkipTmp/334eb676fe1f660a1cc60fc3b98c07c5 2023-10-06 04:02:02,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc1ecc85442c5fd7cf1c49d5ea9f36f7 2023-10-06 04:02:02,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fc1ecc85442c5fd7cf1c49d5ea9f36f7 2023-10-06 04:02:02,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 334eb676fe1f660a1cc60fc3b98c07c5 2023-10-06 04:02:02,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithSkipTmp/334eb676fe1f660a1cc60fc3b98c07c5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 04:02:02,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc1ecc85442c5fd7cf1c49d5ea9f36f7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 04:02:02,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 334eb676fe1f660a1cc60fc3b98c07c5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74307064, jitterRate=0.1072615385055542}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 04:02:02,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fc1ecc85442c5fd7cf1c49d5ea9f36f7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64127491, jitterRate=-0.04442591965198517}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 04:02:02,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 334eb676fe1f660a1cc60fc3b98c07c5: 2023-10-06 04:02:02,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fc1ecc85442c5fd7cf1c49d5ea9f36f7: 2023-10-06 04:02:02,127 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7., pid=109, masterSystemTime=1696564922106 2023-10-06 04:02:02,127 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5., pid=108, masterSystemTime=1696564922106 2023-10-06 04:02:02,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7. 2023-10-06 04:02:02,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7. 2023-10-06 04:02:02,128 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=fc1ecc85442c5fd7cf1c49d5ea9f36f7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5. 2023-10-06 04:02:02,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5. 2023-10-06 04:02:02,128 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696564922128"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696564922128"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696564922128"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696564922128"}]},"ts":"1696564922128"} 2023-10-06 04:02:02,129 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=334eb676fe1f660a1cc60fc3b98c07c5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,129 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696564922129"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696564922129"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696564922129"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696564922129"}]},"ts":"1696564922129"} 2023-10-06 04:02:02,132 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-10-06 04:02:02,132 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure fc1ecc85442c5fd7cf1c49d5ea9f36f7, server=jenkins-hbase4.apache.org,36351,1696564824083 in 175 msec 2023-10-06 04:02:02,132 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-10-06 04:02:02,132 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 334eb676fe1f660a1cc60fc3b98c07c5, server=jenkins-hbase4.apache.org,38169,1696564824132 in 177 msec 2023-10-06 04:02:02,133 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fc1ecc85442c5fd7cf1c49d5ea9f36f7, ASSIGN in 336 msec 2023-10-06 04:02:02,134 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=106, resume processing ppid=105 2023-10-06 04:02:02,134 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=334eb676fe1f660a1cc60fc3b98c07c5, ASSIGN in 336 msec 2023-10-06 04:02:02,134 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-06 04:02:02,135 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696564922134"}]},"ts":"1696564922134"} 2023-10-06 04:02:02,135 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-10-06 04:02:02,138 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-10-06 04:02:02,138 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-10-06 04:02:02,139 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36351] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-06 04:02:02,141 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:02:02,141 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:02:02,141 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:02:02,141 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:02:02,143 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-06 04:02:02,143 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-06 04:02:02,143 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-06 04:02:02,143 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-06 04:02:02,144 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 394 msec 2023-10-06 04:02:02,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-06 04:02:02,355 INFO [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-10-06 04:02:02,357 DEBUG [Listener at jenkins-hbase4.apache.org/34869] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,357 DEBUG [Listener at jenkins-hbase4.apache.org/34869] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5. 2023-10-06 04:02:02,359 INFO [Listener at jenkins-hbase4.apache.org/34869] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 04:02:02,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-06 04:02:02,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696564922369 (current time:1696564922369). 2023-10-06 04:02:02,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 04:02:02,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(139): Connect 0x35c123ba to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 04:02:02,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@737feef7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 04:02:02,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 04:02:02,378 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33552, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 04:02:02,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35c123ba to 127.0.0.1:57105 2023-10-06 04:02:02,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:02:02,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(139): Connect 0x1a9fae01 to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 04:02:02,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26ff821b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 04:02:02,385 DEBUG [hconnection-0x2afbc865-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 04:02:02,388 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33566, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 04:02:02,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a9fae01 to 127.0.0.1:57105 2023-10-06 04:02:02,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:02:02,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-06 04:02:02,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 04:02:02,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-06 04:02:02,395 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot, current working dir path: hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 04:02:02,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-06 04:02:02,397 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-06 04:02:02,397 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696565522397 2023-10-06 04:02:02,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-06 04:02:02,397 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,399 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 04:02:02,399 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 04:02:02,400 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-06 04:02:02,400 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-06 04:02:02,400 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-10-06 04:02:02,401 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-06 04:02:02,402 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696565522402 2023-10-06 04:02:02,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,409 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-06 04:02:02,409 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:02:02,410 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-06 04:02:02,410 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-06 04:02:02,411 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,411 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,413 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:02:02,414 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:02:02,414 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:02:02,414 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:02:02,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:02:02,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:02:02,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:02:02,414 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,414 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:02:02,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:02:02,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,414 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,414 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 04:02:02,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,415 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,415 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-06 04:02:02,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-06 04:02:02,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,415 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-06 04:02:02,415 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-06 04:02:02,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-06 04:02:02,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,415 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,415 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-06 04:02:02,415 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,415 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-06 04:02:02,415 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:02:02,415 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-06 04:02:02,416 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-06 04:02:02,416 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-06 04:02:02,415 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,416 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38169,1696564824132' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-06 04:02:02,416 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-06 04:02:02,416 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:02:02,416 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:02:02,417 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-06 04:02:02,418 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-06 04:02:02,418 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36359,1696564824167' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-06 04:02:02,418 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-06 04:02:02,419 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-06 04:02:02,419 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36351,1696564824083' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-06 04:02:02,425 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,425 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:02:02,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:02:02,425 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,426 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:02:02,426 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,426 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:02:02,426 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,426 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,426 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:02:02,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:02:02,427 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,427 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:02:02,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:02:02,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:02:02,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38169,1696564824132' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-06 04:02:02,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a7fbd49[Count = 1] remaining members to acquire global barrier 2023-10-06 04:02:02,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:02:02,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:02:02,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:02:02,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:02:02,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:02:02,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:02:02,430 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36351,1696564824083' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-06 04:02:02,430 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a7fbd49[Count = 0] remaining members to acquire global barrier 2023-10-06 04:02:02,430 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-06 04:02:02,430 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,431 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,432 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,432 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,432 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-06 04:02:02,432 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,432 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7. 2023-10-06 04:02:02,432 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-06 04:02:02,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,432 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 04:02:02,432 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,432 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 04:02:02,432 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5. 2023-10-06 04:02:02,432 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-06 04:02:02,432 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-06 04:02:02,432 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7. started... 2023-10-06 04:02:02,432 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36359,1696564824167' in zk 2023-10-06 04:02:02,432 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5. started... 2023-10-06 04:02:02,432 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 04:02:02,432 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 04:02:02,432 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 04:02:02,433 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 334eb676fe1f660a1cc60fc3b98c07c5: 2023-10-06 04:02:02,433 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fc1ecc85442c5fd7cf1c49d5ea9f36f7: 2023-10-06 04:02:02,434 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,434 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,434 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 04:02:02,434 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 04:02:02,434 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 04:02:02,434 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 04:02:02,435 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-06 04:02:02,435 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:02:02,435 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-06 04:02:02,445 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7. completed. 2023-10-06 04:02:02,445 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7. 2023-10-06 04:02:02,445 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 04:02:02,445 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 04:02:02,445 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,445 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-06 04:02:02,445 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36351,1696564824083' in zk 2023-10-06 04:02:02,445 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5. completed. 2023-10-06 04:02:02,445 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5. 2023-10-06 04:02:02,445 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 04:02:02,445 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 04:02:02,445 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,445 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-06 04:02:02,445 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38169,1696564824132' in zk 2023-10-06 04:02:02,446 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-06 04:02:02,446 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:02:02,446 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-06 04:02:02,448 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:02:02,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:02:02,449 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,449 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-06 04:02:02,449 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:02:02,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:02:02,449 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-06 04:02:02,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:02:02,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:02:02,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:02:02,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:02:02,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,36351,1696564824083': 2023-10-06 04:02:02,453 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36351,1696564824083' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-06 04:02:02,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:02:02,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:02:02,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:02:02,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:02:02,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:02:02,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:02:02,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:02:02,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,38169,1696564824132': 2023-10-06 04:02:02,456 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38169,1696564824132' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-06 04:02:02,456 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-06 04:02:02,457 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 04:02:02,457 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 04:02:02,457 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,457 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 04:02:02,460 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,460 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,460 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:02:02,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:02:02,460 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,460 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:02:02,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,460 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:02:02,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:02:02,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,460 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:02:02,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:02:02,460 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:02:02,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:02:02,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:02:02,461 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:02:02,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:02:02,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:02:02,462 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:02:02,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:02:02,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:02:02,463 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,464 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,464 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:02:02,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:02:02,466 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:02:02,466 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,467 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:02:02,467 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,467 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,467 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:02:02,467 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:02:02,466 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:02:02,467 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:02:02,468 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,467 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,467 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:02:02,468 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:02:02,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:02:02,468 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:02:02,468 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:02:02,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:02:02,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:02:02,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:02:02,468 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:02:02,468 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,468 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 04:02:02,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:02:02,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:02:02,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:02:02,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:02:02,469 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:02:02,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:02:02,469 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,469 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,469 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,469 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-06 04:02:02,476 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,477 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,499 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 04:02:02,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-06 04:02:02,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-06 04:02:02,500 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 04:02:02,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,502 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-06 04:02:02,502 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,502 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,502 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696564922398Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696564922476 (+78 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696564922476Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696564922476Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696564922480 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696564922496 (+16 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696564922502 (+6 ms) 2023-10-06 04:02:02,505 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-06 04:02:02,506 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 107 msec 2023-10-06 04:02:02,700 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 04:02:02,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-06 04:02:02,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 04:02:02,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38169] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 04:02:02,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36351] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 04:02:02,706 DEBUG [Listener at jenkins-hbase4.apache.org/34869] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,707 DEBUG [Listener at jenkins-hbase4.apache.org/34869] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5. 2023-10-06 04:02:02,707 INFO [Listener at jenkins-hbase4.apache.org/34869] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 04:02:02,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-06 04:02:02,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696564922715 (current time:1696564922715). 2023-10-06 04:02:02,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 04:02:02,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(139): Connect 0x2b0897fd to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 04:02:02,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21352a3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 04:02:02,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 04:02:02,726 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33578, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 04:02:02,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b0897fd to 127.0.0.1:57105 2023-10-06 04:02:02,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:02:02,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(139): Connect 0x145eb829 to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 04:02:02,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b066220, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 04:02:02,734 DEBUG [hconnection-0x6398a1a9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 04:02:02,735 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33586, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 04:02:02,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x145eb829 to 127.0.0.1:57105 2023-10-06 04:02:02,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:02:02,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-06 04:02:02,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 04:02:02,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-06 04:02:02,743 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot, current working dir path: hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 04:02:02,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-06 04:02:02,745 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-06 04:02:02,745 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696565522745 2023-10-06 04:02:02,745 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-06 04:02:02,746 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 04:02:02,746 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 04:02:02,746 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-06 04:02:02,747 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-06 04:02:02,748 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-10-06 04:02:02,749 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-06 04:02:02,749 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696565522749 2023-10-06 04:02:02,760 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,760 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-06 04:02:02,760 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:02:02,761 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-06 04:02:02,761 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-06 04:02:02,762 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,762 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,763 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:02:02,763 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:02:02,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:02:02,763 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,763 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:02:02,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:02:02,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:02:02,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:02:02,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:02:02,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:02:02,764 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,764 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,764 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,764 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 04:02:02,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,764 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,764 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,764 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-06 04:02:02,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-06 04:02:02,765 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-06 04:02:02,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-06 04:02:02,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,765 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,765 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-06 04:02:02,765 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-06 04:02:02,765 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:02:02,765 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-06 04:02:02,766 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-06 04:02:02,766 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-06 04:02:02,766 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38169,1696564824132' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-06 04:02:02,766 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,766 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,766 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-06 04:02:02,766 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:02:02,766 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-06 04:02:02,767 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-06 04:02:02,767 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 04:02:02,767 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-06 04:02:02,768 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-06 04:02:02,768 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-06 04:02:02,768 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36351,1696564824083' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-06 04:02:02,768 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36359,1696564824167' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-06 04:02:02,769 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,769 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:02:02,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:02:02,769 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,769 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:02:02,774 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,774 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,774 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:02:02,774 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,774 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:02:02,774 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,774 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 04:02:02,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:02:02,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:02:02,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:02:02,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38169,1696564824132' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-06 04:02:02,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34e3e5d1[Count = 1] remaining members to acquire global barrier 2023-10-06 04:02:02,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:02:02,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:02:02,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:02:02,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:02:02,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:02:02,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:02:02,778 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36351,1696564824083' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-06 04:02:02,778 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34e3e5d1[Count = 0] remaining members to acquire global barrier 2023-10-06 04:02:02,778 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-06 04:02:02,778 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,782 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,782 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,782 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,782 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-06 04:02:02,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,782 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-06 04:02:02,782 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-06 04:02:02,782 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,783 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 04:02:02,782 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36359,1696564824167' in zk 2023-10-06 04:02:02,783 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 04:02:02,783 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7. 2023-10-06 04:02:02,783 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-06 04:02:02,783 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7. started... 2023-10-06 04:02:02,783 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,783 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 04:02:02,783 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5. 2023-10-06 04:02:02,783 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 04:02:02,783 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 04:02:02,783 INFO [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fc1ecc85442c5fd7cf1c49d5ea9f36f7 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-06 04:02:02,783 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5. started... 2023-10-06 04:02:02,783 INFO [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 334eb676fe1f660a1cc60fc3b98c07c5 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-06 04:02:02,784 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-06 04:02:02,784 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:02:02,784 DEBUG [member: 'jenkins-hbase4.apache.org,36359,1696564824167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-06 04:02:02,801 INFO [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231006ccbab839d0e24014a40ed973e2bee21d to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231006ccbab839d0e24014a40ed973e2bee21d 2023-10-06 04:02:02,801 INFO [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231006425f95e5fcde4d17a6de01cd97043ecf to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20231006425f95e5fcde4d17a6de01cd97043ecf 2023-10-06 04:02:02,808 INFO [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithSkipTmp/334eb676fe1f660a1cc60fc3b98c07c5/.tmp/cf/2e2c5575091b4239b3fc39993ab716b5 2023-10-06 04:02:02,808 INFO [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc1ecc85442c5fd7cf1c49d5ea9f36f7/.tmp/cf/80a0dc67f15d4288827bc39d937650a9 2023-10-06 04:02:02,812 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithSkipTmp/334eb676fe1f660a1cc60fc3b98c07c5/.tmp/cf/2e2c5575091b4239b3fc39993ab716b5 as hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithSkipTmp/334eb676fe1f660a1cc60fc3b98c07c5/cf/2e2c5575091b4239b3fc39993ab716b5 2023-10-06 04:02:02,812 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc1ecc85442c5fd7cf1c49d5ea9f36f7/.tmp/cf/80a0dc67f15d4288827bc39d937650a9 as hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc1ecc85442c5fd7cf1c49d5ea9f36f7/cf/80a0dc67f15d4288827bc39d937650a9 2023-10-06 04:02:02,816 INFO [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithSkipTmp/334eb676fe1f660a1cc60fc3b98c07c5/cf/2e2c5575091b4239b3fc39993ab716b5, entries=4, sequenceid=6, filesize=5.6 K 2023-10-06 04:02:02,816 INFO [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc1ecc85442c5fd7cf1c49d5ea9f36f7/cf/80a0dc67f15d4288827bc39d937650a9, entries=46, sequenceid=6, filesize=13.2 K 2023-10-06 04:02:02,817 INFO [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 334eb676fe1f660a1cc60fc3b98c07c5 in 34ms, sequenceid=6, compaction requested=false 2023-10-06 04:02:02,817 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-10-06 04:02:02,817 INFO [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for fc1ecc85442c5fd7cf1c49d5ea9f36f7 in 34ms, sequenceid=6, compaction requested=false 2023-10-06 04:02:02,817 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-10-06 04:02:02,820 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 334eb676fe1f660a1cc60fc3b98c07c5: 2023-10-06 04:02:02,820 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fc1ecc85442c5fd7cf1c49d5ea9f36f7: 2023-10-06 04:02:02,820 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,820 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,820 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 04:02:02,820 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 04:02:02,820 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithSkipTmp/334eb676fe1f660a1cc60fc3b98c07c5/cf/2e2c5575091b4239b3fc39993ab716b5] hfiles 2023-10-06 04:02:02,820 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc1ecc85442c5fd7cf1c49d5ea9f36f7/cf/80a0dc67f15d4288827bc39d937650a9] hfiles 2023-10-06 04:02:02,820 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithSkipTmp/334eb676fe1f660a1cc60fc3b98c07c5/cf/2e2c5575091b4239b3fc39993ab716b5 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,820 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc1ecc85442c5fd7cf1c49d5ea9f36f7/cf/80a0dc67f15d4288827bc39d937650a9 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,826 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7. completed. 2023-10-06 04:02:02,826 DEBUG [rs(jenkins-hbase4.apache.org,36351,1696564824083)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7. 2023-10-06 04:02:02,826 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 04:02:02,826 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5. completed. 2023-10-06 04:02:02,826 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 04:02:02,826 DEBUG [rs(jenkins-hbase4.apache.org,38169,1696564824132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5. 2023-10-06 04:02:02,826 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,826 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 04:02:02,826 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 04:02:02,827 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,826 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-06 04:02:02,827 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-06 04:02:02,827 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36351,1696564824083' in zk 2023-10-06 04:02:02,827 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38169,1696564824132' in zk 2023-10-06 04:02:02,828 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,828 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-06 04:02:02,828 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,828 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-06 04:02:02,828 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:02:02,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:02:02,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:02:02,829 DEBUG [member: 'jenkins-hbase4.apache.org,38169,1696564824132' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-06 04:02:02,829 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:02:02,831 DEBUG [member: 'jenkins-hbase4.apache.org,36351,1696564824083' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-06 04:02:02,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:02:02,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:02:02,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:02:02,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:02:02,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:02:02,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,36351,1696564824083': 2023-10-06 04:02:02,835 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36351,1696564824083' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-06 04:02:02,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:02:02,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:02:02,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:02:02,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:02:02,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:02:02,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:02:02,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:02:02,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,38169,1696564824132': 2023-10-06 04:02:02,837 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38169,1696564824132' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-06 04:02:02,837 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-06 04:02:02,837 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 04:02:02,837 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 04:02:02,838 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,838 INFO [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 04:02:02,840 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,840 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 04:02:02,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 04:02:02,840 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,840 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:02:02,840 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 04:02:02,840 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:02:02,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,841 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,840 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:02:02,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:02:02,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:02:02,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:02:02,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:02:02,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:02:02,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:02:02,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 04:02:02,841 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,842 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:02:02,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:02:02,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 04:02:02,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,843 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,843 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,843 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:02:02,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:02:02,846 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:02:02,846 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,846 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,846 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:02:02,846 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:02:02,846 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:02:02,846 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,846 DEBUG [(jenkins-hbase4.apache.org,45627,1696564822800)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 04:02:02,846 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 04:02:02,847 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 04:02:02,846 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,846 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:02:02,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:02:02,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:02:02,846 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:02:02,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:02:02,847 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,847 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:02:02,847 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 04:02:02,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 04:02:02,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:02:02,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:02:02,848 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-06 04:02:02,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 04:02:02,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-06 04:02:02,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:02:02,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:02:02,848 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:02,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 04:02:02,848 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:02,848 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,848 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,848 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 04:02:02,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 04:02:02,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 04:02:02,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20231006425f95e5fcde4d17a6de01cd97043ecf, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231006ccbab839d0e24014a40ed973e2bee21d] mob files 2023-10-06 04:02:02,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20231006425f95e5fcde4d17a6de01cd97043ecf 2023-10-06 04:02:02,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231006ccbab839d0e24014a40ed973e2bee21d 2023-10-06 04:02:02,855 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,855 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,880 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,881 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-06 04:02:02,881 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,882 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:02,882 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696564922745Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696564922855 (+110 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696564922855Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1696564922855Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1696564922862 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696564922875 (+13 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696564922881 (+6 ms) 2023-10-06 04:02:02,884 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-06 04:02:02,885 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 138 msec 2023-10-06 04:02:03,048 DEBUG [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 04:02:03,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-06 04:02:03,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 04:02:03,050 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564923050 2023-10-06 04:02:03,050 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42421, tgtDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564923050, rawTgtDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564923050, srcFsUri=hdfs://localhost:42421, srcDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91 2023-10-06 04:02:03,071 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42421, inputRoot=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91 2023-10-06 04:02:03,071 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1261356177_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564923050, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564923050/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:03,071 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42421, inputRoot=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91, snapshotDir=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-10-06 04:02:03,082 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564923050/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:03,095 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-06 04:02:03,095 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-06 04:02:03,095 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-06 04:02:03,096 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-06 04:02:03,096 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-06 04:02:03,096 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-06 04:02:03,096 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-06 04:02:03,163 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/hadoop-1098196136054319246.jar 2023-10-06 04:02:03,164 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-06 04:02:03,164 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-06 04:02:03,164 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-06 04:02:03,165 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-06 04:02:03,165 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-06 04:02:03,165 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-06 04:02:03,166 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-06 04:02:03,166 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-06 04:02:03,166 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-06 04:02:03,167 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-06 04:02:03,167 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-06 04:02:03,167 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-06 04:02:03,168 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-06 04:02:03,168 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-06 04:02:03,168 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-06 04:02:03,169 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-06 04:02:03,169 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 04:02:03,169 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 04:02:03,170 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 04:02:03,170 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 04:02:03,170 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 04:02:03,170 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 04:02:03,171 DEBUG [Listener at jenkins-hbase4.apache.org/34869] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 04:02:03,507 WARN [Listener at jenkins-hbase4.apache.org/34869] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-06 04:02:03,509 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-10-06 04:02:03,511 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-10-06 04:02:06,134 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 04:02:06,134 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 04:02:06,136 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696564830351_0006_000001 (auth:SIMPLE) 2023-10-06 04:02:06,452 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696564830351_0007_000001 (auth:SIMPLE) 2023-10-06 04:02:07,020 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-06 04:02:10,190 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696564830351_0007_000001 (auth:SIMPLE) 2023-10-06 04:02:12,384 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696564830351_0007_000001 (auth:SIMPLE) 2023-10-06 04:02:16,669 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-06 04:02:16,669 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-06 04:02:16,680 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:16,680 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-06 04:02:16,680 INFO [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-06 04:02:16,681 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1023520784_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:16,681 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(367): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-06 04:02:16,681 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(367): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-06 04:02:16,681 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1023520784_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564923050/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564923050/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:16,682 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(367): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564923050/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-06 04:02:16,682 DEBUG [Listener at jenkins-hbase4.apache.org/34869] snapshot.TestExportSnapshot(367): hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/export-test/export-1696564923050/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-06 04:02:16,687 INFO [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:16,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:16,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:16,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-06 04:02:16,691 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696564936691"}]},"ts":"1696564936691"} 2023-10-06 04:02:16,692 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-10-06 04:02:16,694 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-10-06 04:02:16,695 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=334eb676fe1f660a1cc60fc3b98c07c5, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fc1ecc85442c5fd7cf1c49d5ea9f36f7, UNASSIGN}] 2023-10-06 04:02:16,697 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=334eb676fe1f660a1cc60fc3b98c07c5, UNASSIGN 2023-10-06 04:02:16,697 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fc1ecc85442c5fd7cf1c49d5ea9f36f7, UNASSIGN 2023-10-06 04:02:16,697 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=fc1ecc85442c5fd7cf1c49d5ea9f36f7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:16,697 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=334eb676fe1f660a1cc60fc3b98c07c5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:16,697 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696564936697"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696564936697"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696564936697"}]},"ts":"1696564936697"} 2023-10-06 04:02:16,697 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696564936697"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696564936697"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696564936697"}]},"ts":"1696564936697"} 2023-10-06 04:02:16,699 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 334eb676fe1f660a1cc60fc3b98c07c5, server=jenkins-hbase4.apache.org,38169,1696564824132}] 2023-10-06 04:02:16,699 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure fc1ecc85442c5fd7cf1c49d5ea9f36f7, server=jenkins-hbase4.apache.org,36351,1696564824083}] 2023-10-06 04:02:16,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-06 04:02:16,850 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 334eb676fe1f660a1cc60fc3b98c07c5 2023-10-06 04:02:16,850 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fc1ecc85442c5fd7cf1c49d5ea9f36f7 2023-10-06 04:02:16,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 334eb676fe1f660a1cc60fc3b98c07c5, disabling compactions & flushes 2023-10-06 04:02:16,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fc1ecc85442c5fd7cf1c49d5ea9f36f7, disabling compactions & flushes 2023-10-06 04:02:16,851 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5. 2023-10-06 04:02:16,851 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7. 2023-10-06 04:02:16,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5. 2023-10-06 04:02:16,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7. 2023-10-06 04:02:16,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5. after waiting 0 ms 2023-10-06 04:02:16,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5. 2023-10-06 04:02:16,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7. after waiting 0 ms 2023-10-06 04:02:16,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7. 2023-10-06 04:02:16,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc1ecc85442c5fd7cf1c49d5ea9f36f7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 04:02:16,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/default/testtb-testExportFileSystemStateWithSkipTmp/334eb676fe1f660a1cc60fc3b98c07c5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 04:02:16,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 04:02:16,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 04:02:16,863 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7. 2023-10-06 04:02:16,863 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5. 2023-10-06 04:02:16,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fc1ecc85442c5fd7cf1c49d5ea9f36f7: 2023-10-06 04:02:16,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 334eb676fe1f660a1cc60fc3b98c07c5: 2023-10-06 04:02:16,865 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fc1ecc85442c5fd7cf1c49d5ea9f36f7 2023-10-06 04:02:16,865 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=fc1ecc85442c5fd7cf1c49d5ea9f36f7, regionState=CLOSED 2023-10-06 04:02:16,865 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 334eb676fe1f660a1cc60fc3b98c07c5 2023-10-06 04:02:16,865 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696564936865"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696564936865"}]},"ts":"1696564936865"} 2023-10-06 04:02:16,869 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=334eb676fe1f660a1cc60fc3b98c07c5, regionState=CLOSED 2023-10-06 04:02:16,869 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696564936869"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696564936869"}]},"ts":"1696564936869"} 2023-10-06 04:02:16,870 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-10-06 04:02:16,870 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure fc1ecc85442c5fd7cf1c49d5ea9f36f7, server=jenkins-hbase4.apache.org,36351,1696564824083 in 168 msec 2023-10-06 04:02:16,872 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fc1ecc85442c5fd7cf1c49d5ea9f36f7, UNASSIGN in 175 msec 2023-10-06 04:02:16,872 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-10-06 04:02:16,873 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 334eb676fe1f660a1cc60fc3b98c07c5, server=jenkins-hbase4.apache.org,38169,1696564824132 in 171 msec 2023-10-06 04:02:16,874 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=115, resume processing ppid=114 2023-10-06 04:02:16,874 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=334eb676fe1f660a1cc60fc3b98c07c5, UNASSIGN in 178 msec 2023-10-06 04:02:16,874 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696564936874"}]},"ts":"1696564936874"} 2023-10-06 04:02:16,875 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-10-06 04:02:16,877 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-10-06 04:02:16,878 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 190 msec 2023-10-06 04:02:16,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-06 04:02:16,993 INFO [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-10-06 04:02:16,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:16,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:16,997 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:16,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:16,997 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:16,998 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36351] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:17,001 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/334eb676fe1f660a1cc60fc3b98c07c5 2023-10-06 04:02:17,001 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc1ecc85442c5fd7cf1c49d5ea9f36f7 2023-10-06 04:02:17,003 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/334eb676fe1f660a1cc60fc3b98c07c5/cf, FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/334eb676fe1f660a1cc60fc3b98c07c5/recovered.edits] 2023-10-06 04:02:17,003 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc1ecc85442c5fd7cf1c49d5ea9f36f7/cf, FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc1ecc85442c5fd7cf1c49d5ea9f36f7/recovered.edits] 2023-10-06 04:02:17,007 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:17,007 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:17,007 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:17,007 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/334eb676fe1f660a1cc60fc3b98c07c5/cf/2e2c5575091b4239b3fc39993ab716b5 to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/334eb676fe1f660a1cc60fc3b98c07c5/cf/2e2c5575091b4239b3fc39993ab716b5 2023-10-06 04:02:17,007 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:17,007 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc1ecc85442c5fd7cf1c49d5ea9f36f7/cf/80a0dc67f15d4288827bc39d937650a9 to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc1ecc85442c5fd7cf1c49d5ea9f36f7/cf/80a0dc67f15d4288827bc39d937650a9 2023-10-06 04:02:17,008 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-06 04:02:17,008 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-06 04:02:17,008 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-06 04:02:17,009 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:17,009 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:02:17,009 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-10-06 04:02:17,009 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:02:17,009 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:17,009 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:17,009 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-06 04:02:17,009 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:02:17,009 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 04:02:17,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-06 04:02:17,011 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc1ecc85442c5fd7cf1c49d5ea9f36f7/recovered.edits/9.seqid to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc1ecc85442c5fd7cf1c49d5ea9f36f7/recovered.edits/9.seqid 2023-10-06 04:02:17,011 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/334eb676fe1f660a1cc60fc3b98c07c5/recovered.edits/9.seqid to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/334eb676fe1f660a1cc60fc3b98c07c5/recovered.edits/9.seqid 2023-10-06 04:02:17,011 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc1ecc85442c5fd7cf1c49d5ea9f36f7 2023-10-06 04:02:17,012 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/334eb676fe1f660a1cc60fc3b98c07c5 2023-10-06 04:02:17,012 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-06 04:02:17,012 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-06 04:02:17,013 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-10-06 04:02:17,017 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20231006425f95e5fcde4d17a6de01cd97043ecf to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20231006425f95e5fcde4d17a6de01cd97043ecf 2023-10-06 04:02:17,019 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231006ccbab839d0e24014a40ed973e2bee21d to hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231006ccbab839d0e24014a40ed973e2bee21d 2023-10-06 04:02:17,019 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-06 04:02:17,021 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:17,023 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-10-06 04:02:17,025 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-10-06 04:02:17,026 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:17,026 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-10-06 04:02:17,026 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696564937026"}]},"ts":"9223372036854775807"} 2023-10-06 04:02:17,026 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696564937026"}]},"ts":"9223372036854775807"} 2023-10-06 04:02:17,027 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-06 04:02:17,027 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 334eb676fe1f660a1cc60fc3b98c07c5, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696564921747.334eb676fe1f660a1cc60fc3b98c07c5.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => fc1ecc85442c5fd7cf1c49d5ea9f36f7, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696564921747.fc1ecc85442c5fd7cf1c49d5ea9f36f7.', STARTKEY => '1', ENDKEY => ''}] 2023-10-06 04:02:17,028 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-10-06 04:02:17,028 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696564937028"}]},"ts":"9223372036854775807"} 2023-10-06 04:02:17,029 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-10-06 04:02:17,031 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:17,032 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 37 msec 2023-10-06 04:02:17,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-06 04:02:17,111 INFO [Listener at jenkins-hbase4.apache.org/34869] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-10-06 04:02:17,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-06 04:02:17,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:17,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-06 04:02:17,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45627] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 04:02:17,145 INFO [Listener at jenkins-hbase4.apache.org/34869] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764 (was 765), OpenFileDescriptor=907 (was 925), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=161 (was 159) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=5686 (was 5734) 2023-10-06 04:02:17,146 WARN [Listener at jenkins-hbase4.apache.org/34869] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-10-06 04:02:17,146 INFO [Listener at jenkins-hbase4.apache.org/34869] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-10-06 04:02:17,155 INFO [Listener at jenkins-hbase4.apache.org/34869] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-06 04:02:21,450 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696564830351_0007_000001 (auth:SIMPLE) 2023-10-06 04:02:22,431 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-06 04:02:31,280 INFO [Listener at jenkins-hbase4.apache.org/34869] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-06 04:02:45,396 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-06 04:02:45,397 INFO [Listener at jenkins-hbase4.apache.org/34869] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-06 04:02:45,508 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-10-06 04:02:45,519 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-10-06 04:02:45,520 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-06 04:02:45,529 INFO [Listener at jenkins-hbase4.apache.org/34869] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-06 04:02:45,632 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-06 04:02:45,633 INFO [Listener at jenkins-hbase4.apache.org/34869] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-10-06 04:02:45,633 INFO [Listener at jenkins-hbase4.apache.org/34869] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-10-06 04:02:45,633 INFO [Listener at jenkins-hbase4.apache.org/34869] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-06 04:02:45,633 DEBUG [Listener at jenkins-hbase4.apache.org/34869] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6de5d2cc to 127.0.0.1:57105 2023-10-06 04:02:45,633 DEBUG [Listener at jenkins-hbase4.apache.org/34869] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:02:45,633 DEBUG [Listener at jenkins-hbase4.apache.org/34869] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-10-06 04:02:45,633 DEBUG [Listener at jenkins-hbase4.apache.org/34869] util.JVMClusterUtil(257): Found active master hash=1529392900, stopped=false 2023-10-06 04:02:45,633 DEBUG [Listener at jenkins-hbase4.apache.org/34869] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 04:02:45,634 DEBUG [Listener at jenkins-hbase4.apache.org/34869] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-06 04:02:45,634 INFO [Listener at jenkins-hbase4.apache.org/34869] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,45627,1696564822800 2023-10-06 04:02:45,635 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-06 04:02:45,635 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-06 04:02:45,635 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-06 04:02:45,635 INFO [Listener at jenkins-hbase4.apache.org/34869] procedure2.ProcedureExecutor(628): Stopping 2023-10-06 04:02:45,635 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-06 04:02:45,635 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-06 04:02:45,635 DEBUG [Listener at jenkins-hbase4.apache.org/34869] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3dd4d95a to 127.0.0.1:57105 2023-10-06 04:02:45,635 DEBUG [Listener at jenkins-hbase4.apache.org/34869] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:02:45,635 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-06 04:02:45,636 INFO [Listener at jenkins-hbase4.apache.org/34869] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36351,1696564824083' ***** 2023-10-06 04:02:45,636 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-06 04:02:45,636 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-06 04:02:45,636 DEBUG [Listener at jenkins-hbase4.apache.org/34869] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 04:02:45,636 INFO [Listener at jenkins-hbase4.apache.org/34869] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-06 04:02:45,636 INFO [Listener at jenkins-hbase4.apache.org/34869] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38169,1696564824132' ***** 2023-10-06 04:02:45,636 DEBUG [Listener at jenkins-hbase4.apache.org/34869] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 04:02:45,636 INFO [Listener at jenkins-hbase4.apache.org/34869] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-06 04:02:45,636 INFO [Listener at jenkins-hbase4.apache.org/34869] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36359,1696564824167' ***** 2023-10-06 04:02:45,636 INFO [RS:0;jenkins-hbase4:36351] regionserver.HeapMemoryManager(220): Stopping 2023-10-06 04:02:45,636 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-06 04:02:45,636 INFO [RS:1;jenkins-hbase4:38169] regionserver.HeapMemoryManager(220): Stopping 2023-10-06 04:02:45,637 INFO [RS:0;jenkins-hbase4:36351] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-06 04:02:45,637 INFO [RS:1;jenkins-hbase4:38169] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-06 04:02:45,637 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-06 04:02:45,636 DEBUG [Listener at jenkins-hbase4.apache.org/34869] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 04:02:45,637 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-06 04:02:45,637 INFO [RS:1;jenkins-hbase4:38169] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-06 04:02:45,637 INFO [RS:0;jenkins-hbase4:36351] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-06 04:02:45,637 INFO [Listener at jenkins-hbase4.apache.org/34869] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-06 04:02:45,637 INFO [RS:1;jenkins-hbase4:38169] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:45,637 DEBUG [RS:1;jenkins-hbase4:38169] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6eb23143 to 127.0.0.1:57105 2023-10-06 04:02:45,637 INFO [RS:0;jenkins-hbase4:36351] regionserver.HRegionServer(3305): Received CLOSE for cadbe3dac6dec55465caf381df39210e 2023-10-06 04:02:45,637 INFO [RS:2;jenkins-hbase4:36359] regionserver.HeapMemoryManager(220): Stopping 2023-10-06 04:02:45,637 DEBUG [RS:1;jenkins-hbase4:38169] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:02:45,637 INFO [RS:2;jenkins-hbase4:36359] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-06 04:02:45,637 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-06 04:02:45,639 INFO [RS:2;jenkins-hbase4:36359] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-06 04:02:45,639 INFO [RS:1;jenkins-hbase4:38169] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38169,1696564824132; all regions closed. 2023-10-06 04:02:45,639 INFO [RS:2;jenkins-hbase4:36359] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:02:45,639 INFO [RS:0;jenkins-hbase4:36351] regionserver.HRegionServer(3305): Received CLOSE for 1e60c9d8dbb04b6f73f7e208587d1391 2023-10-06 04:02:45,639 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cadbe3dac6dec55465caf381df39210e, disabling compactions & flushes 2023-10-06 04:02:45,639 DEBUG [RS:2;jenkins-hbase4:36359] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x44cb4aa9 to 127.0.0.1:57105 2023-10-06 04:02:45,639 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696564826226.cadbe3dac6dec55465caf381df39210e. 2023-10-06 04:02:45,639 INFO [RS:0;jenkins-hbase4:36351] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:45,639 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696564826226.cadbe3dac6dec55465caf381df39210e. 2023-10-06 04:02:45,639 DEBUG [RS:2;jenkins-hbase4:36359] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:02:45,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696564826226.cadbe3dac6dec55465caf381df39210e. after waiting 0 ms 2023-10-06 04:02:45,640 DEBUG [RS:0;jenkins-hbase4:36351] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2bef1184 to 127.0.0.1:57105 2023-10-06 04:02:45,642 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696564826226.cadbe3dac6dec55465caf381df39210e. 2023-10-06 04:02:45,641 INFO [RS:2;jenkins-hbase4:36359] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36359,1696564824167; all regions closed. 2023-10-06 04:02:45,642 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing cadbe3dac6dec55465caf381df39210e 1/1 column families, dataSize=78 B heapSize=488 B 2023-10-06 04:02:45,642 DEBUG [RS:0;jenkins-hbase4:36351] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:02:45,642 INFO [RS:0;jenkins-hbase4:36351] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-06 04:02:45,642 INFO [RS:0;jenkins-hbase4:36351] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-06 04:02:45,642 INFO [RS:0;jenkins-hbase4:36351] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-06 04:02:45,642 INFO [RS:0;jenkins-hbase4:36351] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-10-06 04:02:45,643 INFO [RS:0;jenkins-hbase4:36351] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-10-06 04:02:45,643 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-06 04:02:45,643 DEBUG [RS:0;jenkins-hbase4:36351] regionserver.HRegionServer(1478): Online Regions={cadbe3dac6dec55465caf381df39210e=hbase:namespace,,1696564826226.cadbe3dac6dec55465caf381df39210e., 1588230740=hbase:meta,,1.1588230740, 1e60c9d8dbb04b6f73f7e208587d1391=hbase:acl,,1696564826968.1e60c9d8dbb04b6f73f7e208587d1391.} 2023-10-06 04:02:45,643 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-06 04:02:45,643 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-06 04:02:45,643 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-06 04:02:45,643 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-06 04:02:45,644 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-10-06 04:02:45,644 DEBUG [RS:0;jenkins-hbase4:36351] regionserver.HRegionServer(1504): Waiting on 1588230740, 1e60c9d8dbb04b6f73f7e208587d1391, cadbe3dac6dec55465caf381df39210e 2023-10-06 04:02:45,656 DEBUG [RS:2;jenkins-hbase4:36359] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/oldWALs 2023-10-06 04:02:45,656 DEBUG [RS:1;jenkins-hbase4:38169] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/oldWALs 2023-10-06 04:02:45,656 INFO [RS:2;jenkins-hbase4:36359] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36359%2C1696564824167:(num 1696564825851) 2023-10-06 04:02:45,656 INFO [RS:1;jenkins-hbase4:38169] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38169%2C1696564824132:(num 1696564825851) 2023-10-06 04:02:45,656 DEBUG [RS:1;jenkins-hbase4:38169] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:02:45,656 DEBUG [RS:2;jenkins-hbase4:36359] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:02:45,656 INFO [RS:1;jenkins-hbase4:38169] regionserver.LeaseManager(133): Closed leases 2023-10-06 04:02:45,656 INFO [RS:2;jenkins-hbase4:36359] regionserver.LeaseManager(133): Closed leases 2023-10-06 04:02:45,658 INFO [RS:1;jenkins-hbase4:38169] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-06 04:02:45,658 INFO [RS:2;jenkins-hbase4:36359] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-06 04:02:45,658 INFO [RS:1;jenkins-hbase4:38169] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-06 04:02:45,658 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-06 04:02:45,658 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-06 04:02:45,658 INFO [RS:2;jenkins-hbase4:36359] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-06 04:02:45,659 INFO [RS:2;jenkins-hbase4:36359] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-06 04:02:45,659 INFO [RS:2;jenkins-hbase4:36359] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-06 04:02:45,658 INFO [RS:1;jenkins-hbase4:38169] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-06 04:02:45,659 INFO [RS:1;jenkins-hbase4:38169] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-06 04:02:45,660 INFO [RS:2;jenkins-hbase4:36359] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36359 2023-10-06 04:02:45,660 INFO [RS:1;jenkins-hbase4:38169] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38169 2023-10-06 04:02:45,671 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-06 04:02:45,671 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:02:45,671 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-06 04:02:45,671 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:02:45,671 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-06 04:02:45,671 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36359,1696564824167 2023-10-06 04:02:45,671 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-06 04:02:45,672 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:45,672 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:45,672 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38169,1696564824132 2023-10-06 04:02:45,672 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38169,1696564824132] 2023-10-06 04:02:45,673 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38169,1696564824132; numProcessing=1 2023-10-06 04:02:45,673 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/namespace/cadbe3dac6dec55465caf381df39210e/.tmp/info/ee4d86cb97324d8f8d9fd5ac796ea368 2023-10-06 04:02:45,674 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/meta/1588230740/.tmp/info/98df6cbd9ca94784bd15781062a41b66 2023-10-06 04:02:45,676 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-10-06 04:02:45,676 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-10-06 04:02:45,677 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38169,1696564824132 already deleted, retry=false 2023-10-06 04:02:45,677 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38169,1696564824132 expired; onlineServers=2 2023-10-06 04:02:45,677 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36359,1696564824167] 2023-10-06 04:02:45,677 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36359,1696564824167; numProcessing=2 2023-10-06 04:02:45,678 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36359,1696564824167 already deleted, retry=false 2023-10-06 04:02:45,678 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36359,1696564824167 expired; onlineServers=1 2023-10-06 04:02:45,679 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 98df6cbd9ca94784bd15781062a41b66 2023-10-06 04:02:45,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/namespace/cadbe3dac6dec55465caf381df39210e/.tmp/info/ee4d86cb97324d8f8d9fd5ac796ea368 as hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/namespace/cadbe3dac6dec55465caf381df39210e/info/ee4d86cb97324d8f8d9fd5ac796ea368 2023-10-06 04:02:45,687 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/namespace/cadbe3dac6dec55465caf381df39210e/info/ee4d86cb97324d8f8d9fd5ac796ea368, entries=2, sequenceid=6, filesize=4.8 K 2023-10-06 04:02:45,688 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for cadbe3dac6dec55465caf381df39210e in 46ms, sequenceid=6, compaction requested=false 2023-10-06 04:02:45,695 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-06 04:02:45,696 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-06 04:02:45,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/namespace/cadbe3dac6dec55465caf381df39210e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 04:02:45,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 04:02:45,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696564826226.cadbe3dac6dec55465caf381df39210e. 2023-10-06 04:02:45,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cadbe3dac6dec55465caf381df39210e: 2023-10-06 04:02:45,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1696564826226.cadbe3dac6dec55465caf381df39210e. 2023-10-06 04:02:45,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1e60c9d8dbb04b6f73f7e208587d1391, disabling compactions & flushes 2023-10-06 04:02:45,699 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696564826968.1e60c9d8dbb04b6f73f7e208587d1391. 2023-10-06 04:02:45,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696564826968.1e60c9d8dbb04b6f73f7e208587d1391. 2023-10-06 04:02:45,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696564826968.1e60c9d8dbb04b6f73f7e208587d1391. after waiting 0 ms 2023-10-06 04:02:45,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696564826968.1e60c9d8dbb04b6f73f7e208587d1391. 2023-10-06 04:02:45,700 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1e60c9d8dbb04b6f73f7e208587d1391 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-10-06 04:02:45,700 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-06 04:02:45,700 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/meta/1588230740/.tmp/rep_barrier/b5a3e44b35254856b8d581a4b8939280 2023-10-06 04:02:45,704 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b5a3e44b35254856b8d581a4b8939280 2023-10-06 04:02:45,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/acl/1e60c9d8dbb04b6f73f7e208587d1391/.tmp/l/e2b12c701ab64f04b9111eb9a4e08c5e 2023-10-06 04:02:45,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e2b12c701ab64f04b9111eb9a4e08c5e 2023-10-06 04:02:45,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/acl/1e60c9d8dbb04b6f73f7e208587d1391/.tmp/l/e2b12c701ab64f04b9111eb9a4e08c5e as hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/acl/1e60c9d8dbb04b6f73f7e208587d1391/l/e2b12c701ab64f04b9111eb9a4e08c5e 2023-10-06 04:02:45,729 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/meta/1588230740/.tmp/table/73bbae3ee48a4c9baa2f604ade2708be 2023-10-06 04:02:45,730 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e2b12c701ab64f04b9111eb9a4e08c5e 2023-10-06 04:02:45,730 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/acl/1e60c9d8dbb04b6f73f7e208587d1391/l/e2b12c701ab64f04b9111eb9a4e08c5e, entries=7, sequenceid=18, filesize=5.2 K 2023-10-06 04:02:45,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 1e60c9d8dbb04b6f73f7e208587d1391 in 32ms, sequenceid=18, compaction requested=false 2023-10-06 04:02:45,736 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 73bbae3ee48a4c9baa2f604ade2708be 2023-10-06 04:02:45,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/acl/1e60c9d8dbb04b6f73f7e208587d1391/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-10-06 04:02:45,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 04:02:45,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1696564826968.1e60c9d8dbb04b6f73f7e208587d1391. 2023-10-06 04:02:45,745 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/meta/1588230740/.tmp/info/98df6cbd9ca94784bd15781062a41b66 as hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/meta/1588230740/info/98df6cbd9ca94784bd15781062a41b66 2023-10-06 04:02:45,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1e60c9d8dbb04b6f73f7e208587d1391: 2023-10-06 04:02:45,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1696564826968.1e60c9d8dbb04b6f73f7e208587d1391. 2023-10-06 04:02:45,750 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 98df6cbd9ca94784bd15781062a41b66 2023-10-06 04:02:45,750 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/meta/1588230740/info/98df6cbd9ca94784bd15781062a41b66, entries=48, sequenceid=131, filesize=10.3 K 2023-10-06 04:02:45,751 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/meta/1588230740/.tmp/rep_barrier/b5a3e44b35254856b8d581a4b8939280 as hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/meta/1588230740/rep_barrier/b5a3e44b35254856b8d581a4b8939280 2023-10-06 04:02:45,756 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b5a3e44b35254856b8d581a4b8939280 2023-10-06 04:02:45,756 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/meta/1588230740/rep_barrier/b5a3e44b35254856b8d581a4b8939280, entries=13, sequenceid=131, filesize=6.4 K 2023-10-06 04:02:45,757 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/meta/1588230740/.tmp/table/73bbae3ee48a4c9baa2f604ade2708be as hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/meta/1588230740/table/73bbae3ee48a4c9baa2f604ade2708be 2023-10-06 04:02:45,762 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 73bbae3ee48a4c9baa2f604ade2708be 2023-10-06 04:02:45,762 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/meta/1588230740/table/73bbae3ee48a4c9baa2f604ade2708be, entries=24, sequenceid=131, filesize=6.9 K 2023-10-06 04:02:45,763 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 120ms, sequenceid=131, compaction requested=false 2023-10-06 04:02:45,773 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-10-06 04:02:45,773 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 04:02:45,773 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-06 04:02:45,774 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-06 04:02:45,774 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-06 04:02:45,774 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-10-06 04:02:45,775 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-06 04:02:45,775 INFO [RS:2;jenkins-hbase4:36359] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36359,1696564824167; zookeeper connection closed. 2023-10-06 04:02:45,775 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36359-0x10119e3f72b0003, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-06 04:02:45,775 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@357b2a96] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@357b2a96 2023-10-06 04:02:45,844 INFO [RS:0;jenkins-hbase4:36351] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36351,1696564824083; all regions closed. 2023-10-06 04:02:45,850 DEBUG [RS:0;jenkins-hbase4:36351] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/oldWALs 2023-10-06 04:02:45,850 INFO [RS:0;jenkins-hbase4:36351] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36351%2C1696564824083.meta:.meta(num 1696564825953) 2023-10-06 04:02:45,855 DEBUG [RS:0;jenkins-hbase4:36351] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/oldWALs 2023-10-06 04:02:45,855 INFO [RS:0;jenkins-hbase4:36351] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36351%2C1696564824083:(num 1696564825851) 2023-10-06 04:02:45,855 DEBUG [RS:0;jenkins-hbase4:36351] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:02:45,855 INFO [RS:0;jenkins-hbase4:36351] regionserver.LeaseManager(133): Closed leases 2023-10-06 04:02:45,855 INFO [RS:0;jenkins-hbase4:36351] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-06 04:02:45,856 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-06 04:02:45,856 INFO [RS:0;jenkins-hbase4:36351] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36351 2023-10-06 04:02:45,859 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36351,1696564824083 2023-10-06 04:02:45,859 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-06 04:02:45,860 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36351,1696564824083] 2023-10-06 04:02:45,860 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36351,1696564824083; numProcessing=3 2023-10-06 04:02:45,861 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36351,1696564824083 already deleted, retry=false 2023-10-06 04:02:45,861 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36351,1696564824083 expired; onlineServers=0 2023-10-06 04:02:45,861 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45627,1696564822800' ***** 2023-10-06 04:02:45,861 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-10-06 04:02:45,861 DEBUG [M:0;jenkins-hbase4:45627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a15a53f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-06 04:02:45,862 INFO [M:0;jenkins-hbase4:45627] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45627,1696564822800 2023-10-06 04:02:45,862 INFO [M:0;jenkins-hbase4:45627] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45627,1696564822800; all regions closed. 2023-10-06 04:02:45,862 DEBUG [M:0;jenkins-hbase4:45627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 04:02:45,862 DEBUG [M:0;jenkins-hbase4:45627] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-10-06 04:02:45,862 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-10-06 04:02:45,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696564825426] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696564825426,5,FailOnTimeoutGroup] 2023-10-06 04:02:45,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696564825431] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696564825431,5,FailOnTimeoutGroup] 2023-10-06 04:02:45,862 DEBUG [M:0;jenkins-hbase4:45627] cleaner.HFileCleaner(317): Stopping file delete threads 2023-10-06 04:02:45,862 INFO [M:0;jenkins-hbase4:45627] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-10-06 04:02:45,862 INFO [M:0;jenkins-hbase4:45627] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-10-06 04:02:45,862 INFO [M:0;jenkins-hbase4:45627] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-10-06 04:02:45,862 DEBUG [M:0;jenkins-hbase4:45627] master.HMaster(1512): Stopping service threads 2023-10-06 04:02:45,862 INFO [M:0;jenkins-hbase4:45627] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-10-06 04:02:45,863 ERROR [M:0;jenkins-hbase4:45627] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-10-06 04:02:45,863 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-10-06 04:02:45,863 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-06 04:02:45,863 INFO [M:0;jenkins-hbase4:45627] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-10-06 04:02:45,863 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-06 04:02:45,863 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-10-06 04:02:45,864 DEBUG [M:0;jenkins-hbase4:45627] zookeeper.ZKUtil(398): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-10-06 04:02:45,864 WARN [M:0;jenkins-hbase4:45627] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-10-06 04:02:45,864 INFO [M:0;jenkins-hbase4:45627] assignment.AssignmentManager(315): Stopping assignment manager 2023-10-06 04:02:45,864 INFO [M:0;jenkins-hbase4:45627] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-10-06 04:02:45,864 DEBUG [M:0;jenkins-hbase4:45627] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-06 04:02:45,864 INFO [M:0;jenkins-hbase4:45627] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-06 04:02:45,864 DEBUG [M:0;jenkins-hbase4:45627] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-06 04:02:45,865 DEBUG [M:0;jenkins-hbase4:45627] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 1 ms 2023-10-06 04:02:45,865 DEBUG [M:0;jenkins-hbase4:45627] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-06 04:02:45,865 INFO [M:0;jenkins-hbase4:45627] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.87 KB heapSize=452.11 KB 2023-10-06 04:02:45,875 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-06 04:02:45,875 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:38169-0x10119e3f72b0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-06 04:02:45,875 INFO [RS:1;jenkins-hbase4:38169] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38169,1696564824132; zookeeper connection closed. 2023-10-06 04:02:45,892 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6d1b5c89] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6d1b5c89 2023-10-06 04:02:45,895 INFO [M:0;jenkins-hbase4:45627] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.87 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f3ab29b5f6a54043bb77de1a76c0057a 2023-10-06 04:02:45,899 INFO [M:0;jenkins-hbase4:45627] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f3ab29b5f6a54043bb77de1a76c0057a 2023-10-06 04:02:45,900 DEBUG [M:0;jenkins-hbase4:45627] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f3ab29b5f6a54043bb77de1a76c0057a as hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f3ab29b5f6a54043bb77de1a76c0057a 2023-10-06 04:02:45,904 INFO [M:0;jenkins-hbase4:45627] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f3ab29b5f6a54043bb77de1a76c0057a 2023-10-06 04:02:45,904 INFO [M:0;jenkins-hbase4:45627] regionserver.HStore(1080): Added hdfs://localhost:42421/user/jenkins/test-data/6d89dba3-06aa-3e5f-638f-e5ba13586b91/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f3ab29b5f6a54043bb77de1a76c0057a, entries=119, sequenceid=899, filesize=28.7 K 2023-10-06 04:02:45,904 INFO [M:0;jenkins-hbase4:45627] regionserver.HRegion(2948): Finished flush of dataSize ~375.87 KB/384889, heapSize ~452.09 KB/462944, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 39ms, sequenceid=899, compaction requested=false 2023-10-06 04:02:45,906 INFO [M:0;jenkins-hbase4:45627] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-06 04:02:45,906 DEBUG [M:0;jenkins-hbase4:45627] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-06 04:02:45,910 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-06 04:02:45,910 INFO [M:0;jenkins-hbase4:45627] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-10-06 04:02:45,911 INFO [M:0;jenkins-hbase4:45627] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45627 2023-10-06 04:02:45,913 DEBUG [M:0;jenkins-hbase4:45627] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,45627,1696564822800 already deleted, retry=false 2023-10-06 04:02:45,975 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-06 04:02:45,975 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): regionserver:36351-0x10119e3f72b0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-06 04:02:45,975 INFO [RS:0;jenkins-hbase4:36351] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36351,1696564824083; zookeeper connection closed. 2023-10-06 04:02:45,976 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@142585a5] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@142585a5 2023-10-06 04:02:45,976 INFO [Listener at jenkins-hbase4.apache.org/34869] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-10-06 04:02:46,075 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-06 04:02:46,075 INFO [M:0;jenkins-hbase4:45627] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45627,1696564822800; zookeeper connection closed. 2023-10-06 04:02:46,076 DEBUG [Listener at localhost/37595-EventThread] zookeeper.ZKWatcher(600): master:45627-0x10119e3f72b0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-06 04:02:46,077 WARN [Listener at jenkins-hbase4.apache.org/34869] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-06 04:02:46,079 INFO [Listener at jenkins-hbase4.apache.org/34869] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-06 04:02:46,183 WARN [BP-1296308559-172.31.14.131-1696564819492 heartbeating to localhost/127.0.0.1:42421] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-06 04:02:46,183 WARN [BP-1296308559-172.31.14.131-1696564819492 heartbeating to localhost/127.0.0.1:42421] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1296308559-172.31.14.131-1696564819492 (Datanode Uuid aa1714cb-842d-4067-b1b0-9cb6e05681f8) service to localhost/127.0.0.1:42421 2023-10-06 04:02:46,185 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/cluster_452f40ba-4ad6-c109-846f-078298d21c32/dfs/data/data5/current/BP-1296308559-172.31.14.131-1696564819492] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-06 04:02:46,185 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/cluster_452f40ba-4ad6-c109-846f-078298d21c32/dfs/data/data6/current/BP-1296308559-172.31.14.131-1696564819492] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-06 04:02:46,186 WARN [Listener at jenkins-hbase4.apache.org/34869] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-06 04:02:46,188 INFO [Listener at jenkins-hbase4.apache.org/34869] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-06 04:02:46,290 WARN [BP-1296308559-172.31.14.131-1696564819492 heartbeating to localhost/127.0.0.1:42421] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-06 04:02:46,290 WARN [BP-1296308559-172.31.14.131-1696564819492 heartbeating to localhost/127.0.0.1:42421] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1296308559-172.31.14.131-1696564819492 (Datanode Uuid 3359534a-726f-4e44-a325-db30a916325c) service to localhost/127.0.0.1:42421 2023-10-06 04:02:46,291 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/cluster_452f40ba-4ad6-c109-846f-078298d21c32/dfs/data/data3/current/BP-1296308559-172.31.14.131-1696564819492] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-06 04:02:46,291 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/cluster_452f40ba-4ad6-c109-846f-078298d21c32/dfs/data/data4/current/BP-1296308559-172.31.14.131-1696564819492] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-06 04:02:46,292 WARN [Listener at jenkins-hbase4.apache.org/34869] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-06 04:02:46,294 INFO [Listener at jenkins-hbase4.apache.org/34869] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-06 04:02:46,397 WARN [BP-1296308559-172.31.14.131-1696564819492 heartbeating to localhost/127.0.0.1:42421] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-06 04:02:46,398 WARN [BP-1296308559-172.31.14.131-1696564819492 heartbeating to localhost/127.0.0.1:42421] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1296308559-172.31.14.131-1696564819492 (Datanode Uuid 945ea537-ad1e-44be-b06f-b09fce1700fd) service to localhost/127.0.0.1:42421 2023-10-06 04:02:46,398 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/cluster_452f40ba-4ad6-c109-846f-078298d21c32/dfs/data/data1/current/BP-1296308559-172.31.14.131-1696564819492] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-06 04:02:46,398 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fbb69c29-32b9-5283-a7c5-c80efd2f6e75/cluster_452f40ba-4ad6-c109-846f-078298d21c32/dfs/data/data2/current/BP-1296308559-172.31.14.131-1696564819492] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-06 04:02:46,417 INFO [Listener at jenkins-hbase4.apache.org/34869] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-06 04:02:46,543 INFO [Listener at jenkins-hbase4.apache.org/34869] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-10-06 04:02:46,630 INFO [Listener at jenkins-hbase4.apache.org/34869] hbase.HBaseTestingUtility(1293): Minicluster is down